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Abstract 

Evolutionary algorithms (EAs), simulating the evolution process of natural species, are used to solve 
optimization problems. Crossover (also called recombination), originated from simulating the chro- 
mosome exchange phenomena in zoogamy reproduction, is widely employed in EAs to generate off- 
spring solutions, of which the effectiveness has been examined empirically in applications. How- 
ever, due to the irregularity of crossover operators and the complicated interactions to mutation, 
crossover operators are hard to analyze and thus have few theoretical results. Therefore, analyzing 
crossover not only helps in understanding EAs, but also helps in developing novel techniques for 
analyzing sophisticated metaheuristic algorithms. 

In this paper, we derive the General Markov Chain Switching Theorem (GMCST) to facilitate theo- 
retical studies of crossover-enabled EAs. The theorem allows us to analyze the running time of a 
sophisticated EA from an easy-to-analyze EA. Using this tool, we analyze EAs with several crossover 
operators on the LeadingOnes and OneMax problems, which are noticeably two well studied prob- 
lems for mutation-only EAs but with few results for crossover-enabled EAs. We first derive the 
bounds of running time of the (2+2) -EA with crossover operators; then we study the running time 
gap between the mutation-only (2:2) -EA and the (2:2) -EA with crossover operators; finally, we de- 
velop strategies that apply crossover operators only when necessary, which improve from the mutation- 
only as well as the crossover-all-the-time (2:2) -EA. The theoretical results are verified by experi- 
ments. 

Key words: Evolutionary algorithms, crossover operator, expected first hitting time, running time, 
computational complexity 
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1. Introduction 



Evolutionary algorithms are inspired by the evolution process of natural species, i.e., nature selec- 
tion and survival of the fittest, and are used as randomized optimization algorithms, which have 
been widely applied to diverse areas (e.g. [l^ilzii 13|). Starting from a random population of so- 



lutions, EAs iteratively apply reproduction operators to generate a set of offspring solutions from 
the current population, and then apply a selection operator to weed out bad solutions. As EAs were 
motivated by simulation of natural evolution process, the reproduction operators are originated 
from reproduction phenomena of natural animals, typically including mutation and crossover (also 
called recombination), which simulate the mutation phenomena in DNA transformation and the 
chromosome exchange phenomena in zoogamy reproduction, respectively. EAs significantly differ 



3111 , as well as from heuris- 



from classical optimization techniques, e.g. branch-and-bound strategy 

tic search methods, e.g. simulated annealing jsil, in that EAs maintain a population of solutions 
during the evolution process [gl other than a single solution, and apply mutation and crossover 
operators on the population. 

Contrary to mutation operators, crossover operators are defined on a population of solutions, i.e., 
they generate offspring solutions by mixing up a set of (usually two) solutions. Moreover, crossover 
operators were born together with the first genetic algorithm. Crossover is therefore a special char- 
acteristic of EAs. Questions related to crossover, such as why it works and how frequently it should 
be used, have been argued since the emerging of EAs [3l • It was initially explained by the schema 
theory that crossover can utilize 'building blocks' to construct good solutions. However, it had been 
proved (lOfl that the schema theory concerns little to the convergence rate of EAs, while the con- 
vergence rate was later proved to have a tight connection to the running time (37|l, which is the 
center concern of EAs solving optimization problems, and thus the schema theory is of little use. 
There have been studies disclosing several properties of crossover operators. In |23|], the 'step size', 
measured by inversion of the expected distance between the leftmost bit and the leftmost crossover 
point in a solution, is assumed critical to crossover operator and is studied empirically. In [32] , using 
schema theory as well as a multimodel problem generator for experiments, the construction and de- 
struction probabilities, and equilibrium of crossover operator were studied thoroughly. While these 
studies provided valuable hints, we are more interested in the theoretical properties of crossover 
impacting the running time of EAs. 
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The field of theoretical analysis of EAs develops very fast in the recent decade 
a landscape of computational complexity of EAs is emerging. However, due to the hardness of an- 
alyzing crossover operators, these theoretical studies did not involve crossover until recently (e.g. 
tl^lalsoll)- It has been found that crossover can play an important role on the running time of EAs. 
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In some cases, the crossover operators are the key to solve problems, they drastically reduce the 
running time. Meanwhile, opposite effect of crossover has also been discovered. Detailed related 
analysis work is reviewed in Section 2. The analysis approach used to obtain the results could be 
summarized as follows. Given a particular EA and a particular problem, define phases of the opti- 
mization process, and bound the time consumed in each phase, so that the total time is bounded. 
Hence the analysis is done case-by-case. 

In this paper, we derive the General Markov Chain Switching Theorem (GMCST) to facilitate the 
analysis of EAs with crossover. The theorem compares two Markov chains for their average running 
time of hitting a target state. GMCST compares the one-step transition behaviors of the two Markov 
chains, while involving the long-term behavior of only one of the chains. Therefore, to analyze a 
sophisticated chain, we can compare it with a simply-to-analyze chain via GMCST, so that we only 
need to consider the one-step transition behavior of the sophisticated chain. Section 5 presents the 
GMCST 

Modeling EAs by Markov chains, we analyze crossover-enabled EAs using GMCST in this paper. 
We use two model problems in the analysis, the LeadingOnes and the OneMax problems, which 
are introduced in Section 3. It is noteworthy that though the two model problems are the most 
well-studied problems for mutation-only EAs, there are few results on how the crossover effect the 
running time on the problems, since they are not specifically designed for easing the analysis of 
crossover-enabled EAs. To theoretically study the EAs with crossover, we particularly concern three 
aspects: 

• How to bound the asymptotic running time of crossover-enabled EAs. Asymptotic running 
time is a central theoretical problem of algorithm analysis, and it is particularly interesting for 
sophisticated algorithms such as EAs with crossover. 

• How is the running time of crossover- enabled EAs compared with their counterpart mutation- 
only EAs. Practically, we choose among possible configurations of an algorithm to solve a 
problem. Thus it would be helpful to choose a good configuration by knowing whether apply 
of a crossover operator is good or not. 

• Can we use crossover smartly rather than throughout the evolutionary process. Usually the 
operators are used no matter what the current solutions are. Operators however are rarely 
useful all the time, thus applying the operators only when necessary would improve the per- 
formance of EAs. 

We analyze crossover operators in the three aspects Section 6, 7 and 8, respectively. In Section 6, 
we use GMCST to bound the running time of (2+2) -EA with crossover on the model problems, and 
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obtain upper bounds as well as lower bounds. The analysis also demonstrates how to use GMCST 
to bound the running time. In Section 7, we compare the running time of (2:2) -EA with and without 
crossover, which for the first time discloses that the crossover harm the running time on the model 
problems. In Section 8, we then design strategies that use crossover only under some conditions 
according to the GMCST, rather than throughout the evolutionary process. We prove that the de- 
signed strategies result in better running time. The theoretical results are verified by experiments in 
Section 9. The paper is concluded in Section 10. 



2. Related Work 

There have been cases analyzing the influence of crossover on the running time of EAs. We review 
some of the results in this section. 

Rabani et al. Q proposed to model the crossover process by a quadratic Markov chain, which also 
reveals the hardness of analysis of crossover. Using a set partition model, the process of crossover 
was reduced so that the mixing time can be bounded. However, the crossover process analyzed was 
without mutation or selection, thus the result has little connection with the running time of EAs. 



In |3a], the running time of several crossover-only algorithms was analyzed on the H-IFF problem 
which is hard for any kind of mutation-based EAs. In the H-IFF problem, a solution is divided into 
sub-blocks with log n levels, and the fitness of the solution is counted as how many sub-blocks are 
pure (all 1 or all 0) in all the levels. The problem is so designed that local optima and global optima 
are distant in Hamming space, but are close in crossover space. In 0), on the same H-IFF problem, 
the asymptotic running time of a simplified crossover-only EA was proved to be 9 (n In n) , by analysis 
from two equivalent coloring games on the fitness trees. 

In , it was proved that on JUMP and Real Royal Road problems, the EA with mutation only re- 

quires super-polynomial and exponential running time, but when the crossover operator is applied 
(with a small probability and a large population), the running time reduces to be polynomial. In the 
problem of JUMP, solutions with the same number of 1 bits are assigned the same fitness. Similar 
as in the OneMax problem, the fitness increases as the number of 1 bits increases, except in a valley 
surrounding the optimal solution, where the fitness are set very low. EA with mutation only reaches 
the optimal solution only by jumping over the gap, which can take super-polynomial running time, 
while the gap is eliminated in the crossover space. The problem of Real Royal Road is alike, but en- 



courages long blocks of 1 bits. Kotzing et al. |20|l enriched the analysis results by showing that a small 
population is enough for crossover, but a large crossover probability will lead to super-polynomial 
running time. 
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The Ising model is a graph coloring problem which encourages vectors to have the same color as 
their neighbors. It was proved that for Ising model on rings |f ll|l and on trees 1 34] , crossover operator 
helps to reduce the running time from O(n^) to O(n^) and from 17(2") to 0{n^), respectively. 

In 



2211 . a TwoPath problem in computing unique -input- output sequences of finite state machines 
was studied, where there are local optima trapping the mutation-only EAs. On this problem, the 
crossover operator reduces the running time from il{2") to 0{m?ix log ^ + exp(n In n — pt/96)), where 
the latter can be polynomial if ^, the population size, is larger than 96n In n. 



In |27l], the vertex cover problem was examined for population-based EAs. It was found that, on a 
particular class of vertex cover problem, no single bit mutation can save the EA from local optima, 
but only crossover operator can. Thus the crossover operator helps to reduce the running time from 
exponential to be polynomial. 

In , the all-pairs shortest path problem was studied, which is a non- artificially designed prob- 
lem class. The crossover operators improve the running time from 0(n"') to 0{n^-^ log^^^(n)), and 
thentoO(n^^^ \og^^^{n)) by their improved analysis. The analysis reveals that mutation and crossover 
operators can work in different phases of the optimization of the problem. In Ql , crossover on the 
all-pairs shortest path problem was further studied. Two concepts in crossover, repair mechanisms 
and parent selection, were analyzed, which led to improved expected running time 0(n^-^ (log ri)°^) 
and 0{n^ log n), respectively. 

In |2al, the crossover was studied in the setting of the island model of parallel EA. In the island 
model, the population of the EA is divided into several subpopulations. The subpopulations evolve 
independently, and only for an interval of time the superior solutions of a subpopulation migrate 
to other subpopulations in order to share the information of evolution. The island model creates 
diversity among subpopulations naturally, which are particular suitable for crossover. Neumann 
et al. fZM proved the effectiveness of crossover for a constructed problem and an instance of the 
vertex cover problem using the parallel EA. 

While most of the studies prove the usefulness of crossover, Richter et al. Is^ presented a show case 
where it can be proved that the crossover operator harms the running time of the EA. In that work, a 
problem called Ignoble Trails is constructed. In the problem, over the solution space {0, 1}", all the 
solutions are designed to have increased fitness towards a trap solution 0", except one path towards 
the optimal solution. For this problem, the mutation-only EA was proved to foUow the path easily, 
which costs 0{n'^ Infc) steps with dominating probability and k being a constant. However, when 
the crossover operator is enabled, the EA will get stuck in a local minimum due to the crossover op- 
erator, and will take exponential time to jump out the local minimum with dominating probability. 
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Most recently, there emerge studies of the effect of crossover in multi-objective EAs. Neumann and 
Theile |3l first showed that crossover can be helpful in multi-objective EAs by constructing solu- 



tions that fit better the subsequent mutation process. Qian et al. |28|] discovered that crossover can 
accelerate fulfilling the Pareto front for multi-objective problems. 

As a summary of the common analysis approach used to obtain the above results, one can define 
phases of the optimization process by considering the specific characteristics of the problem, and 
bound the time consumed in each phase, so that the total time is bounded, and in the analysis of 
each phase, one finds how mutation and crossover act. To show that a crossover enabled EA is more 
powerful, the asymptotic time complexity is bounded and is shown lower than that of mutation- 
only EA. However, there would be no general guild to analyze crossover-enabled EAs. 

Moreover, it is notably that diversity among solutions is not only regarded as a key factor for the ef- 
fectiveness of crossover, and is also a condition for theoretical analysis. For examples, the invariant 
GA (3I and the the shuffle GA 13 crossover the current solution with a virtual solution which is gen- 
erated from the current solution to have a large diversity. However, this kind of crossover operators 
can actually be implemented by mutation operators, and is quite different with the crossover over 
a population of evolved solutions. We are therefore interested in analyzing crossover-enabled EAs 
without extra diversity encouraging mechanisms. 



3. Evolutionary Algorithms and Model Problems 

The (l-i-l)-EA IqI is the simplest EA described in Definition[TJ which maintains one solution and uses 
a mutation operator to generate one new solution at a time. 

Definition! ((l-hl)-EA) 

Given solution lengtli n and objective function f, (1+1)-EA consists of the following steps: 

1. (Initialization) s := randomly selected from {0, 1}". 

2. (Reproduction) s' := mutation{s); 

3. (Selection) lff{s') > f{s), s s' 

4. (Stop Criterion) Terminates if s is optimal. 

5. (Loop) Goto step 2. 

where mutation{-) is a mutation operator 

The mutation is commonly implemented by the one-bit mutation or the bitwise mutation. The (l-i-l)- 
EA with one-bit mutation is also called randomized local search. 

one-bit mutation for each solution, randomly choose one of the n bits, and flip (0 to 1 or inverse) 
the chosen bit. 
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bitwise mutation for each solution, flip each bit with probability 1 jn. 



When the (f+l)-EA generates solutions with the same fitness as its current solution, it performs a 
random walk as it will accept the newly generated solutions. We define the (1+1>)-EA as the (1+1)- 
EA without random walk, i.e., it only accepts better solutions by setting /(«') > /(s) in the line 4 of 
the (1+1)-EA. 

The (1+1)-EA does not involve crossover operators, as a crossover operator recombines parts of at 
least two solutions. A possible extension of (1+1) -EA for enabling crossover operators is to recom- 
bine the current solution with a virtual solution, which can be as t he g ene invariant GA recom- 



bining with the inverse of the current solution and as the shuffle GA |20|1 recombining with a random 
shuffle of the current solution. We however study a more common setting where the EA maintains 
a population of solutions and applies an crossover operator on the solutions in the population. 

We consider the (2:2) -EA as in Definition [2] and the (2+2) -EA as in Definition |3] both maintaining 
two solutions in a population. Note that the case of population size being 2 is sufficient to show the 
effect of crossover operators as used in Issl-lsol. 

Definition 2 ((2:2) -EA) 

Encode each solution by a string with n binary bits, and let every population, denoted by variable ^, 

contain 2 solutions. The (2:2)-EA consists of the following steps: 

1. (Initialization) t <— 0. := randomly selected two solutions from {0, 1}". 

2. Let{si,s2} denote the two solutions in S^f 

3. (Reproduction) Chooser e [0, 1] uniformly at random. 

Ifr < pc, {s'l, S2} •= crossover{s 1,82) 

else, {s'i,S2} := {mutation{si), mutation{s2)}. 

4. (Selection) £_t+i := {argmax /(s), argmax /(s)}. 

5. (Stop Criterion) Terminates if an optima is found. 

6. (Loop) t ^ t + 1. Goto step 2. 

where mutation{-) is a mutation operator that maps X ^ X, cmssover{-, •) is a crossover operator that 

maps X X X ^ X X X , Pc is the crossover probability. 
Definitions ((2+2) -EA) 

Encode each solution by a string with n binary bits, and let every population, denoted by variable ^, 
contain 2 solutions. The (2+2) -EA consists of the following steps: 
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1. (Initialization) t 0. := randomly selected two solutions from {0, 1}". 

2. Let{si, S2} denote the two solutions in S^f 

3. (Reproduction) Chooser g [0, 1] uniformly at random. 
Ifr < pc, {s'l, S2} crossover{si,S2) 

else, {s'ljsi^} := {mutation{si), mutation{s2)}. 

4. (Selection) S^t+i ■= the best two solutions in {si,S2,s[,S2} which have the two largest fitness value. 

5. (Stop Criterion) Terminates if an optima is found. 

6. (Loop) t ^ t + 1. Goto step 2. 

where mutation{-) is a mutation operator that maps X ^ X, crossover^-, ■) is a crossover operator that 

maps XxX^XxX,pcis the crossover probability. 

Both the (2:2) -EA and the (2+2) -EA apply the crossover operator instead of the mutation operator 
with probability pc- They differ in the way of selection: (2:2) -EA compares between an offspring 
solution and its direct parent which is equivalent to two parallel (1+1)-EA if pc = 0, and (2+2)-EA 
compares among all the offspring and parent solutions. Note that, for (2:2) -EA, we track the off- 
spring by their names, i.e., si and S2. For example, no matter how many bits of si are exchanged 
with S2, the result solution is the offspring of si. 

Our analysis will involve some crossover operators: 

one-point crossover for the current two solutions, scan the solutions left-to-right, randomly choose 
one of the first n - 1 bit positions, and exchange all the bits after the position. 

uniform crossover for the current two solutions, exchange each bit with probability 1 /n. 

one-bit crossover for the current two solutions, randomly choose one of the n bit positions, and 
exchange the bit on that position. 

EAs can be used for various problems, but are often analyzed on some model problems to discover 
their theoretical properties. The LeadingOnes and the OneMax are two model problems, defined 
respectively in Definitions|4]and[5l that have been used to study EAs. It has been known that (1+1)- 
EA takes expected 9 (n^ ) running time on the LeadingOnes problem, and 9 (n In n) running time on 
the OneMax problem 1 8] . However, the results about how crossover operators effect EAs are few. 

Definition 4 (LeadingOnes Problem) 

LeadingOnes Problem of size n is to find an n bits binary string s* such that, defining LO{s) = 

s* = arg max iO(s). 

se{o,i}" 
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Definition 5 (OneMax Problem) 

OneMax Problem of size n is to find an n bits binary string s* such that 

n 

s* = argmax > Sj. 

«6{0,1}" ,= 1 



4. Modeling EAs as Markov Chains 

EAs are modeled and analyzed as Markov chains Considering combinatorial optimization 

problems, a Markov chain with discrete state space is constructed to model an EA, by mapping the 
populations of EAs to the states of the Markov chain. Suppose an EA encodes a solution into a vector 
with length n, each component of the vector is drawn from an alphabet set B, and each population 
contains m solutions. Let s(a) denote the a-th bit of the solution s. Let S denote the solution space, 
which contains \S\ = solutions. Let X denote the population space, which contains \X\ = 
(™^'m"~^) populations |35]. A Markov chain {^t}tS) modeling the EA is constructed by taking X as 
the state space, i.e. G X. Let X* c X denote the set of all optimal populations, which contains 
at least one optimal solution. The goal of EAs is to reach X* from an initial population. Thus, the 



371. 



process of an EA seeking X* can be analyzed by studying the corresponding Markov chain [l5, 
Definition 6 (Absorbing Markov Chain) 

Given a Marlcov cfiain {Ct}it^(Ct G X) and a target subspace X* c X, {6}tt^ is said to be an ab- 
sorbing ciiain, if 

Vt > : Pfe+i iX* \^t(^X*)=0. 



All practical EAs track the best-so-far solutions during the evolution process. This kind of EAs can 
be modeled as absorbing Markov chains. EAs with no time-variant operators can be modeled as 
homogeneous Markov chains, where it holds that 

\ft>0^x,yeX:P{^t+i\Ct)^P{^i\^o). 
Definition 7 (Conditional first hitting time, CFHT) 

Given a Marlcov chain {6}tt^(Ct £ ^ target subspace X* c X, starting from time i when 

= X, letTf be a random variable that denotes the hitting events: 



Ti = 0:t,e X*, 

Ti^l: ft+i ex* A 6 ^X*{i = t) , 
Ti^2: e A e, iX*{i^ i, i+l), 
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The mathematical expectation ofr^, 



+00 

1=0 

is called the conditional first hitting time (CFHT) of the Markov chain from i and = x. 
Definitions (Distribution-CFHT, DCFHT) 

Given a Markov chain {Ct}t^){(,t e X) cind a target subspace X* c X, starting from timet, if^f is 
drawn from a distribution n of states, the mathematical expectation of the CFHT overS^f, 

xex 

is called the distribution- conditional first hitting time (DCFHT) of the Markov chain from i and 

tt - ^- 

Definition 9 (Expected first hitting time) 

Given a Markov chain {S,t}t^ (Ct e &nd a target subspace X* c X, the DCFHT of the chain from 
t = and uniform distribution ttu. 



:[t1 =E[to Uo^ttJ 
= IEx~7r„ [to ICo = a;]] 



\X\ 
xex ' 



is called the expected first hitting time (EFHT) of the Markov chain. 



Note that this definition of EFHT is equivalent to those used in Il5|,[l6|,|37|l . The EFHT implies the av- 
erage computational time complexity of EAs, thus provides a measure of goodness for EAs. Since the 
Markov chain models the essential of EA process, EFHT of an EA or its corresponding Markov chain 
won't be distinguished for convenience. The following are two lemmas on properties of Markov 



chain Il2ll . 
Lemma 1 

Given an absorbing Markov chain {^tjt^iCt € X) and a target subspace X* c X , we have, for CFHT, 

\/x (^X* ■.nrt\^t = xl = i + J2 = y Ut = xMn+i I 6+1 = yl 

and for DCFHT, 

E[Tt I 6 - M = ^x^.An \Ct = xl = l- nt{X*)+ElTt+i I 6+1 - TTt+ll 
where TTt+iix) = Y.yexMy)P{£.t+i =x\^t = y)- 
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Lemma 2 

Given an absorbing homogeneous Mariiov cliain ^ a target subspace X* c X, it 

holdsyti,t2 : E[n, I 61 - a;] = E[Tt, I ^t, - 

5. General Markov Chain Switching Theorem 

Given two Markov chains {6 IS ^^'^ {^i'}£o modeling two EAs, let r and t' denote the hitting 
events of the two chains, respectively. We present the general Markov chain switching theorem, 
stated in Theorem[l] that compares E [[t| with E [r'l 

Theorem 1 [General Markov Chain Switching Theorem (GMCST)) 

Given two absorbing homogeneous Marizov chains {6}tt^ and {Ct}t^- Let X and y denote the 
state space of £,t and £,'f , respectively. Let r and t' denote the hitting events of^t and ^J, respectively. 
LetTTt denote the distribution ofS^f Let {pt}t^ be a series of numbers whose sum converges to p. If 
there exists a mapping cf) : X -^y, (j){x) e 3^* if and only if x e X*; and it satisfies that 

: ^7rt(x)P(6+i e rHy) I 6 - xMt' I C+1 = yl (D 
< (>) E <iyi)P(it+i = y2 1 e^ = yi)E[r' I ^t+i = y2l + pu 

yi,y2ey 

where ^ {x e X \ (f){x) = y} and-K^ijj) = ■nt{4>^^{y)), andE[r | ^0 ^ 'I'ol is finite, itwillhold 

that 

E[rUo^7rol<(>)E[r'|e^^^^I+p. 

Proof. We prove "<" case, since ">" can be proved similarly. Denote the transition of ^ as tr, and 
the transition of by ^' as tr' . 

We define the intermediate Markov chain {C'^j^t^ as a Markov chain that 

1. is in the state space X and has the same initial state distribution with the chain ^, i.e., ttq = ttq; 

2. uses tr at time {0, 1, . . . , fc - 1}, i.e., it is identical with the chain ^ at the first fc - 1 steps; 

3. switches to the state space y just before time fc, which is by mapping the distribution Tik of 
states over X to the distribution tt^ of states over y via 0; 

4. uses tr' from time fc. 

For any t <k, since the chain and ^ are identical before the time fc, we have nt = Trf , and thus 

Vt<fc:7r,'=(A'*) = 7rt(A'*)=^^(r), (2) 
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since 7ro(?/) = 7ro((/i ^{y)) and(l){x) e 3^* if and only if x e X*. 

For any t > k, since the chain S^'' and ^' are in the same space and uses the same transition, we have 

VyeJ^iE^r'^ -yl-E[r' UJ = yl, (3) 

We prove the theorem by induction on the k of the intermediate Markov chain 

(a) Initialization is to prove EJt^ | ^ T^ai < E Jt' | ""ol + Po< i-e., fc = 1. Since tr is applied only 

at t = 0, 

= l-no{X*) + ^7ro(a;)P(C! £ 0-^2/) | = a;)E[r' | = yl 
< 1 - 7ro(A'*) + ^ 7r^,(yi)P(e; = \ = ViMr' I = ^2] + Po 
= l-7r^(r)+ E ^o(2/i)^(ei =2/2Uo=yi)ElT'K;=y2l+po 
= E[r' U^^vr^,]+po, 

where the first, second and the last equalities are by Lemma [TJ the third is by Eq|3l the following 
inequality is by Eq[T]and the fourth equality is by Eq|2]. 

(b) Inductive Hypothesis assumes that, 

fc-i 

-ik<K-\{K> 1), I ^ TTo] < EIr' [ ^ ^[,1 + ^ p*. 
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Then, for fc = i^T, we have 

xex.yey 

<K-J2'^j\t{x*) + PK-i+ E ^K-iiyi)PieK^y2\eK-i^yiMr'\eK^y2} 

vi,v2&y 

= K- Y!1^^ ^t{X*) - 7r^-i(r ) + PK-i 

+ ^'K-i{yi)P{^'K^y2\i'K-i^yi)nr' \(,'K^y2\ 

yi,y2ey 

K-2 

<E[r' U^^7r^,] + E Pt+PK-i 
t=o 

where the first and fourth equalities are by Lemma[TJ the second is by Eq|3] the third is by Eq|2l the 
first inequality is by Eq[TJ and the second inequality is by inductive hypothesis, 
(c) Conclusion from (a) and (b], it holds 

EIr- I Co°° TTol < E[r' | i'^ ~ + ^^^^ pt- 

Finally, since E[[t | ^ tto]] is finite, E[r°° | tto]] = EJr | ^ ttq], and since {pt}t^ is a series 
of numbers whose sum converges to p, Y^^o Pt = p < oo, thus E|t | t^o\ < Ejr' | ~ ttq]] + 
p. □ 

The GMCST is helpful to our analysis of EAs with crossover operators. Note that, in EqUJ there is no 
need of calculating the term E |t' | ^^[^^ = y|, which is the long- term behavior of the chain ^, but only 
need to compare the one-step transition behavior of the two chains, i.e., P(Ct+i e (t>^^{y) \ — x) 
andP(^t^j — y2 \ — yi). Therefore, to analyze the running time of an EA with crossover operators, 
we can let the Markov chain ^ model this EA, then let the Markov chain ^' modeling an simple (even 
unrealistic) algorithm that is easy to be analyzed. By the GMCST, we accomplish the analysis by 
comparing the one-step transition probabilities and deriving the conditional first hitting time of 
the simple algorithm. 

The only requirement of the mapping function </> is that it maps optimal states to optimal states in 
the two state spaces. Therefore, it is possible that 4)^^{y) is undefined for some y e y. In this case, 
we simply treat 7ri((/)"^(y)) = 0. 
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6. Running Time Analysis of Crossover- Enabled EAs 

In the first aspect, we address how to analyze running time of crossover-enabled EAs. We derive 
upper and lower bounds of the running time using GMCST in this section. 

6.1. On LeadingOnes problem 

According to the GMCST, we need to compare the target EA with a reference algorithm. We choose 
the reference algorithm to be the (1+1>)-EA with one-bit mutation running on the LeadingOnes 
problem, for which we have the following property. 

Proposition 1 

Let ^' be the Markov chain modeling the (l+ly)-EA with one-bit mutation running on the Leadin- 
gOnes problem. It then satisfies that Vs e {0,1}" : lEIr'l^^ = sj = n{n - \\s\\), where \\ ■ || is the 
1 -norm, i.e., the number of 1 's. 

Denote E(j) as the CFHT Elr'l^^ = sj with ||s|| = n - j, i.e., E(j) = n-j. We then derive the rurming 
times of EAs in the following theorems. Also remember that LO{s) is the number of leading ones of 
a solution s. 

Theorem 2 

For the LeadingOnes problem, the EFHT of (2+2)-EA with one-point or uniform crossover and one- 
bit or bitwise mutation is not larger than (i_p")22^ E"=i(2" - 2■'"^)^ i.e., O(y^). 

Proof. We use (1+1>)-EA with one-bit mutation running on the LeadingOnes problem as the refer- 
ence algorithm. Denote ^ € X as the Markov chain modeling the (2+2) -EA, and ^' eyas the Markov 
chain modeling the (1+1>)-EA. 

We construct a mapping (/) : X ^ y asWx £ X : (j){x) = in^^HLOiy)\yex}Qn-maK{LO{y)\vex} _ ^ is easy 
to see that the mapping ^ satisfies that <l){x) e y* if and only ifxeX*. 

Then, we investigate the formula, which is the condition of the GMCST, 

Y,Mx)P{^t+i G r\y) I 6 = x)EIt' I ^^+1 = y} 

xex,yey 

-Y,<{yi)m+i = y2\^'t = yiW I C^+i = 2/2!. 

For any x £ X* , since (j){x) e 3^*, we have 

m+i e r\y) 1 6 = x)eIt' I et+1 = yl 

yey 
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= J2 piC+i = y\^'t = fixmir' I = 2/1 = 0. 

yey 

For any x ^ X* with maxy^^ LO{y) = n - j{0 < j < n), when using one-bit mutation on x, the next 
population x' satisfies that max^ga:' LO{y) > n- j with probability at least ^, since the best parent 
solution can increase the number of leading ones with probability K Then, we have 

^ P(6+i e I 6 = x)eIt' I ^t+i = 2/1 

yey 

< -E(i - 1) + (1 - -)E(i); 
n n 

when using bitwise mutation on x, the next population x' satisfies that maxyg^/ LO{y) > n — j with 
probability at least (^^p-)" > ^> since the best parent solution can increase the number of 
leading ones with probability (^^)"~^^- Then, we have 

J2 Piit+i e r\y) I 6 = x)eIt' I Ct+i = 2/1 

< — E(j - 1) + (1 - -)E(i). 

en en 

Since iE(j - 1) + (1 - i)E(j) < ^E(i - 1) + (1 - ■^)E(j), we use the bound of the bitwise mutation 
in the following derivation for unifying the result for the two mutation operators. 

When using one-point or uniform crossover on x, considering the worst case, the next population 
x' satisfies that max^gx' LO{y) > n- j, since the (2+2)-EA keeps the best so-far solution. Then, we 
have 

^ p(6+i G r\y) 1 6 = x)eit' I et+1 = 2/1 < E(j). 

yey 

Since f{x) is the solution 1"~^0^, we have 

E ^(^^+1 = I = ^i^))nr' I C^+i = 2/1 
yey 

= lEO--l) + (l-l)E(i). 

Combining the mutation with crossover, 

yx^X*:J2 mt+i e <p-\y) I 6 = a:)E[T' I = 2/1 
- E = 2/ U^ = '/'(2^))E[r' I ^t+i = 2/1 

< + (1 - Pc)(^E(j - 1) + (1 - ^)E(i)) - (lE(j - 1) + (1 - ^)E(j)) 

(iiV Cfb IV ft 

= 1-^(1-Pe). 
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Then, considering all x, we have 

< = y = 0(:^^))]E[r' I = yi + (i - \{i-Pcm~^t{x*)) 

= Y.<(y^)Pi^'t+i -y2\C = yiMr' I = y2l + (1 - 1(1 Pc)){i - M^D- 

yi,y2ey 

ByGMCSXwegetEIr | ^o] < Elr' | Co - Kl + i^^ -ei^~Pc))EZo(^- M^*))- Since j:Zo{'^- 
TTtiX*)) = E[t I ^0 ^ ^ol, wehaveEIr | ~ ttoI < j^Efr' \ Co - ^^,1- 

Then, we need to derive the DCFHT Efr' | ttq]. Since ttq is the uniform distribution over the 
population space {{0, 1}"}^, we have 

VI < j < n : 7ro(l"-^0^) = no{(f>'\r'^0^)) 
— 7ro({x e X I max LO(y) — n — j}) 

yex 

(2" - 2^'"i)2 - (2" - 2-'')2 

7ro(l") = (2")^-(2"^i)^ ^ ^j^^ ^ {PO'^-i \ < j <n} : 7r^(y) = 0, where the term 2" - 2^-^ is the 
number of the populations with not larger than n - j number of leading ones. Thus, we have 

n n 

andE[r | ^0 ttoI < S;^^(2" - 2^-1)2. □ 

Theorem 3 

For the LeadingOnes problem, the EFHT of (2+2)-EA with one-point crossover and one-bit or bit- 
wise mutation is not less than (5_2p^)2^r. Ej=i(2" - 2^^1)2, i.e., 

Proof. The proof is similar to that of Theorem|2l except we derive inequalities inversely. We also use 
(1+1>)-EA with one-bit mutation running on the LeadingOnes problem as the reference algorithm, 
denote ^ e A" as the Markov chain modeling the (2+2) -EA and ^' e y as the Markov chain modeling 
the (1+1>)-EA, and use the mapping 0(x) = inii^HLO{y)\y&x}Qn-mi,^{LO{y)\y&x} _ 

When the current population x — {si, S2}. we denote LOi and LO2 be the number of leading ones 
of si and S2 respectively. For some i and j such that < j < i < n, we denote Xi,j as the population 
space consisting of all the populations with LOi = n-i and LO2 = n- j. We assume LOi ^ n-i < 
LO2 = n-j. It is not difficult to see that, for a current solution, the bits after the first bit position are 
randomly distributed, i.e., being 1 or with 0.5 probability, since these bits are randomly initialized 
and the selection operator does not bias the distribution of them until now. 
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When using one-bit mutation on a; G Xij, with probability (1 - ^)'^, the first bits of the two current 
solutions are not flipped, thus do not make any progress; with probability (1 - ^) ^ the first bit of 
S2 is flipped but the first bit of si is not, in which case we consider the probability that there are 
k e {1, ... ,j - 1} following 1 bits so that the progress is k; with probability (1 - the first bit 
of si is flipped but the first bit of S2 is not, in which case we consider the probability that there are 
k' e {i- j + following 1 bits so that the progress is k'. We therefore obtain that 

J2 nm^t+i e r'iy) I 6 = ^Mr' I ^^+1 = 2/1 

fe'=i-j+l / 

when using bitwise mutation, the situation is the same as that using one-bit mutation, except the 
probability that neither of the solutions have their first bit flipped or the leading 1 bits are de- 
stroyedis ((1 - + (1 - • ((1 - ^) + (1 - < (1 - the probability 

that the first bit of S2 is flipped but that of si is not is (1 - ^)^"'""~^ ^ > ^ and the probability 
that the first bit of si is flipped but that of S2 is not is (1 - > in order to keep the 

leading 1 bits. So we have 

J2 G r'iy) I 6 = x)eIt' I C+i = y} 

\ fc=l 

k'=i-j+l / 

= ..(^,,)(eO-) -In- i)(2 - + ^) - (2 - 1)11) . 

Since E(i) - i(l - i)(2 - ^)(1 + ^) - (2 - > E{j) - (1 - i)(2 - + 5^) - we will 

use the bound for one-bit mutation in the following derivation for unifying the results for mutation 
operators. 

When using one-point crossover, progress can only be achieved if the crossover point is between the 
first bits of the two solutions, so that the leading 1 bits from S2 joint the tailing bits from S2 to make 
a better solution. In an optimistic case, we assume LOi ^ LO2 such that the progress can happen. 
Recall that LOi = n - i < LO2 = n - j, there are i - j positions where crossover is able to make 
progress, each of these positions is taken with probability For each of these positions, we then 
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count the probability that the progress of e {0, . . . , j} bits is achieved. 

J2 m+i e r\y) I 6 - x)eIt' I C+1 = 2/1 

/ , , N / LOi „ , , n — 1 — -LOo „ , N 

= Mx^^J) — -rm) + 

\ n — 1 n — 1 



E(i - A:) 1 
2q+k 2^^1+9 



+i:;r^(a->o) + i: 

g=l \ k=l 

= ^.(^..)(lE(.)-^(2-^)(l-^)). 
Since is the solution 1"^^ 0^ , we have 

- -E(i - 1) + (1 - -)E(i) = EO') - 1. 
n n 

Thus, we have 

^ P(6+i G r'{y) I 6 = a;)E[r' | C+i = 2/1 

- E ^(^^+1 = y I ^^ = 0(^))]Elr' I = 2/1 

7? 1 1 

> p,7r,(^,,)(E0-) - ^(1 - ^)(2 - ^)) 

+ (1 -p,)7r,(A',,,.)(E(j) - (1 - i)(2 - ^)(1 + ^) - ^) 

Then, we have 

vt ■.j2M=^)m+i e r^2/) I = ^Mr' i = 2/i 

> E ^y\C = H^)Mr' I = 2/1 + (2pc - 4)(1 - 

= J2 ^MPiCt+i = 2/2 = 2/i)E[t' I Ct+i = 2721 + (2p. - 4)(1 - ^X*)). 
ByGMCSXwegetElr | Co - ttqI > E[r' | ^ 7r;,l + (2p,-4) Et=o(l-'^*('^*))- Thus, E[t | ^ ttqI > 

From the proof of TheoremE] we know E|r' | £,'q ~ tt^]] = 2^E^=i(2" - 2^-1)2. Thus, we get 
E[r I Co ~ ^ol > (532^ E;=i(2" - 2^-1)2. □ 
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Theorem 4 

For the LeadingOnes problem, the EFHT of (2+2) -EA with uniform crossover and one-bit or bitwise 
mutation is not less than (2„-"i)25n E"=i(2" - 2^-^)^, i.e., n{n). 

Proof. We use (1+1>)-EA with one-bit mutation running on the LeadingOnes problem as the refer- 
ence algorithm. Denote ^ G X as the Markov chain modeling the (2+2) -EA and ^' G 3^ as the Markov 
chain modeling the (1+1>)-EA, and use the mapping ^ : X which satisfies that Va; e X : (p{x) = 

-^inax{LO{y)\y&x}Qn—inax{LO{y)\yEx} 

For any x ^ X*, suppose that ma.Xy(=x LO{y) — j{0 < j < n). If using one-bit mutation or bitwise 
mutation on x, the next population x' satisfies that niax,^g ,.' LO{y) = n — j with probability (1 - i)^ 
when the first bits of the two solutions do not flip. Then, we have 

5] P(6+i e r\y) I 6 = x)Elr' I ^t+i = 2/1 > (1 - Irm- 

yey 

If using uniform crossover on x, the next population x' satisfies that maxy^x' LO{y) = n - j with 
probability (1 - i)^ when the bits on the position L02 + 1 and LOl -I- 1 do not exchange. Then, we 
have 

^ p(6+i e r'iy) I 6 = x)Elr' I ^^+1 = 2/1 > (1 - k'E{j). 
yey 

Since <f>{x) is the solution 1"~^0-' , we have 

E ^(^t+i =y\^'t= <Pix)Mr' I ^^+1 = 2/1 
yey 

= lEO-_l) + (l_i)E(j). 
Thus, we have 

\fx^X*:J2 m+i e ct>-\y) I 6 = a;)ElT' | C^+i = 2/1 

- E ^(^^+1 = y = <^(^))EIr' I ^^+1 = 2/1 

> p,{l - -^Eij) + (1 - - i)2E0-) - (IeO- - 1) + (1 - -)E(j)) 

n n n n 

= 1 - 27 -h - > 2 - 2n. 
n 

Then, we have 

> E TTtWPCC^+i = 2/ = <^(a;))E|r' I C^+i = 2/1 + (2 - 2n)(l - nt{X*)) 

xex.yey 

= J24iyi)Pi^t+i = 2/2 I = ViMt' I = yal + (2 - 2n)(l - MX*)). 

yi,y2ey 
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ByGMCST,wegetElT | - ^ol > Hr' I Co - 7r^l + (2-2n) E,to(l-^t('^*))- Thus, E[t | - vro] > 
FromtheproofofTheorem|2]weknowE[[T' | - vr^l = 2^X;"=i(2"-2^"^)^-Thus,wegetE[r | - t^oI > 

n Y^" [-on _ r,J-1^2 r-i 



6.2. On OneMax problem 



Proposition 2 

Let ^' be the Markov chain modeling the (1+1)-EA with one -bit mutation running on the OneMax 
problem. It then satisfies thafis e {0, 1}" : E|t'|^J = s\ ~ nHn-\\s\\, where \\ ■ || is the 1-norm, i.e., 
the number of 1 's, and Hk = J2i=i j ^'^^ harmonic number. 

We reuse the notation E(j) in this subsection as the CFHT of the {1+1)-EA with one-bit mutation 
running on the OneMax problem given ||s|| = n - j, so that E(j) = nHj. 

Tiieorem 5 

For the OneMax problem, the EFHT of (2+2)-EA with one-point or uniform crossover and one-bit or 
bitwise mutation is not larger than j^^^ EU l^^l=j dO)'' i-^- 

Proof. We use the {l-i-l)-EA with one-bit mutation running on the OneMax problem as the reference 
algorithm. We use the mapping function (/>(a;) = argmaxygj; \\y\\. It is easy to see that the mapping 
satisfies that (l){x) e y* if and only if a; e Af*. 

For any x ^ X* with maxj^g^ ||y|| = n - j{0 < j < n). When using one-bit mutation, since the 
probability of flipping a bit of j O's in the solution is ^, we have 

p(6+i e r\y) 1 6 = x)nr' I = y\ 

yey 

<:^E(j-l) + (l-:^)E(j); 
n n 

when using bitwise mutation, the probability that the solution wQl have less O's after the mutation 
is at least ^(ii;^)"-^ > i^,thus 

^ P(6+i e r\y) I 6 = x)nr' I = y\ 

yey 

< -^EU - 1) + (1 - — )E(j). 

en en 

Since ^E(j - 1) + (1 - ■j^)E(j) > m{j - 1) + (1 - ^)E(j), we use the bound for the bitwise mutation 
in the following derivation for unifying the results for the two mutation operators. 
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When using one-point or uniform crossover, considering the worst case and that the (2+2) -EA keeps 
the best so-far solution, we have 

^ P(6+i G r\y) I 6 = x)nT' I i't+i =y\< e(j). 

Since (j){x) is a solution with j O's, we have 

E ^(^^+1 = y K^ = '/'(^))E[r' I C^+i = 2/1 
= ^E(i-l) + (l-^)E(i). 

Combining the mutation and the crossover operator, 

- E ^(^^+1 = y I = 0(^))Elr' I = 2/1 

< pM3) + (1 - Pc)(-]E(j - 1) + (1 - — )]E(i)) - (^E(j - 1) + (1 - ^)E(j)) 
en en n n 

= l-i(l-Pe). 

e 

Then, considering all x, we have 

Mt : E^*(^)^(6+i e ^1(2/) I 6 = ^)ieIt' I ^t+x = yl 



< E^*(^)^(C^+i = y I = <^(a;))]EEr' I = yl + (1 - \{i-Pc)){i - MX*)) 
= J27T[iy,)P{et+i =y2\et= ViMr' I ^t+i = y2l + (1 - i(i -Pc))(i - MX*)). 



yi,V2&y 

ByGMCSXwegetEIr | - M < Mr' I ~ 7r^,l+(l-i(l-pe)) Et=o(l-'^t('^*))- Thus, E^r | Co ~ ttqI < 
^Elr'ie^-TT^,]. 

Then, we derive the DCFHT E |r' | ""ol • Since ttq is the uniform distribution over the population 
space {{0, 1}"}^, we have 

VO < i < n : n'oiiy €y\n- \\y\\ = j}) = MirHy) I n - \\y\\ = j}) 
= 7ro({a; G X \ max \\y\\ = n - j}) 

yex 

/v^n (■n\\2 _ (X^n ("\\2 



22" 

=j (fc) 



where the term J2k=j O ^he number of populations with at least j number of O's. Thus, we have 



Mr' I ^'o ~ ^^1 =^<{{y e y I Ibll = n-j})nH, = ^ E ^(E U 

j=i j=i J k=j ^ ^ 

andE[r | 6 - M < i(EL, il))'- □ 
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Theorem 6 

For the OneMax problem, the EFHT of (2+2) -EA with uniform crossover and one-bit or bitwise mu- 
tation is not less than E"=i(2" - 2^1)^ i.e., n{n). 

Proof. Instead of using (1+1)-EA with one-bit mutation running on the OneMax problem, here we 
use (1+1>)-EA with one-bit mutation running on the LeadingOnes problem as the reference algo- 
rithm. Denote ^ e A" as the Markov chain modeling the (2+2) -EA and ^' e y as the Markov chain 
modeling the (1+1>)-EA, and use the mapping (p : X ^ y which satisfies that Vx e <Y : (/)(a;) — 
^max{LO(y)|yej;}o"-max{LO(y)|yei;} ^Q^-g ^j^^t tWs mapping allows US to comparc the two EAs running 
on different problems. The remaining proof is therefore identical to that of TheoremUl We repeat 
the proof below. 

Foranyx ^ A"*, suppose that maxyga; LO(y) = n-j{Q < j < n). If using one-bit mutation or bitwise 
mutation on x, the next population x' satisfies that niaxj,ga;' LO{y) ^ n — j with probability (1 - i)^ 
when the first bit of the two solutions do not flip. Then, we have 

J2 m+i e r\y) 1 6 = xMt' I Ct+i = yi > (1 - -fm- 

If using uniform crossover on x, the next population x' satisfles that maxj^g^/ LO{y) = n - j with 
probability (1 — i)^ when the bits on the position L02 + 1 and LOl + 1 do not exchange. Then, we 
have 

^y 

Since (l){x) is the solution 1"^^ 0^ , we have 

E ^(^^+1 = y\Ct = 0(^))IElr' 1 Ct+i = yi 

yey 

= -E{j - 1) + (1 - -)E(i). 
n n 

Thus, we have 

yxix*:Y, m+i e r\y) I 6 = ^Mr I C+i = 2/1 
yey 

- E ^(^^+1 ^y\^'t^ ^i^)Mr' I Ct+i = 2/1 
yey 

> - -fEij) + (1 - - i)2E0-) - (iE(j - 1) + (1 - -)E(j)) 

= 1 - 2j + - > 2 - 2n. 
n 



22 



Then, we have 

xex,yey 

> J2M^)PiCt+i = 2/ = mmr' I a+i = 2/1 + (2 - 2n)(l - MX*)) 

xex,yey 

= Y.Myi)P{^'t+, = 2/2 = 2/i)E[t' I ^^+1 = y^l + (2 - 2n)(l - 7rt(A'*)). 
ByGMCST,wegetE[T | Co ^ol > IE[r' Uo ^ 7r^l + (2-2n) E^^gll-^tlA-*)). Thus, E[r | ^ ttqI > 

From the proof of TheoremElwe know E[[t' | Co vr^l = 2^E"=i(2"-2J-i)2.Thus,wegetE[r | ttqI > 
I2;^E;=i(2"- 2^-1)2. □ 

7. Running Time Comparison of Crossover On and Off 

In the second aspect, we would like to know if it is better to use an crossover operator in an EA. We 
need to compare the running time of an EA turning crossover on and off. In this section, we study 
the (2:2) -EA on the model problems to address that if enabling one-bit crossover operator is good or 
not. 

7.1. On LeadingOnes problem 

Let the Markov chain ^ model the (2 : 2)-EA with one-bit crossover and one-bit mutation running 
on the problem, and C' model the (2 : 2)-EA with one-bit mutation only. 

First, we analyze the one-step transition behavior of the (2 : 2)-EA with and without the crossover 
on the LeadingOnes problem, i.e., to figure out P(Ct+i I 6) and P{it+i \ Ct)- 
Proposition 3 

For any non-optimal population x — {si, S2}, denote s'l and s'2 as the solution wliich flips the first 
bitofsi and the solution which flips the first Obit of S2, respectively. LetLOi andL02 bethenumber 
of leading ones ofsi and S2, respectively. Then, for {i't}^^, we have 

P(.i't+i - {x,{s'^,S2},{si, s'2}, {3^,82}} I = x) = 0; 
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and for {^f}J^Q, ifLOi = LO2, we have 

P{^t+i = a; I 6 - 2;) = + ^ 

Vy e A- - {x} : = y | 6 = 2:) = (1 - Pc)P{i't+i =y\S.'t^ x); 

ifLOi < LO2, we have 

u(c ! ' lie ^ -Pc , (1 -Pc){n - 1) 



P(6+i = {si,4}l6=2:) = 



(i-p.K»-i) ^ ifsi(L02 + 1) = 1, 
otherwise, 



c(n-2) , (l-p,)(„-l) 



ifsi{L02 + l) = 1, 



^ (i-p.)(«-i) otherwise, 



^(6+1 = X 16 = a;) = < 
Vy e A" - {a;, {s'l, S2}, {si, 4}} : ^(6+1 = y \ it = x) = {I ~ Pc)P{£.'t+^ =y\S,[ = x). 

For the Markov chain it is obvious that the CFHTEJr' | 6' = {si,s2}] only depends on the number 
of I's of the two solutions, i.e., {||si||, ||s2||}, where || • || denotes the 1-norm, i.e., the number of 1 bits. 
Given a population {si,S2} with ||si|| = n - i and ||s2|| = n - j, we denote E(z, j) as the CFHT 
I £,1 = {si,S2}l of EA using mutation only. It is easy to see that E(i,j) = E{j,i). 

Then, we give two propositions on the properties of the CFHT E|t' | = {si, S2}I|. Proposition[4]is 
the instantiation of Lemma[T]for (2:2)-EA with mutation only on the LeadingOnes problem. Proposi- 
tion[5]compares the CFHT of two adjacent populations, i.e., there is only one bit difference between 
the solutions of the two populations. Then Proposition [6] deals with the probability distribution 
when the two solutions have the same leading ones. 

Proposition 4 

The CFHT of on the LeadingOnes problem satisfies that 

Vi > 0,E(i,0) = E{0,i) = 0; 

71^ Tl — 1 Tl — 1 1 

> 1,E(^,,) = ^ + ^E(. - 1,,) + ^E(,, - 1) + ^E(^ - 1,, - 1). 
Proposition 5 

The CFHTof{C't}+^ satisfies that 

Tl 

Vi>l,(5>l: E{i,i + S)-E{i,i + 5-l)>^j^, 

> 1, (5 > : E(i, i + S)-E{i-l,i + S) <n - ^^^^^"3^^ . 
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Proposition 6 

For the Markovchain {^t}tS, the probability that the two solutions in the population {si, S2} after 
t steps have the same number of leading ones and both of them are not optimal satisfies that 

MLO, - LO2 <n)>{\~ ^){Pc + (1 - Pc)(l - 

3 3-4" n 

where LOi andL02 are the number of leading ones ofsi ands2, respectively. 

Theorem 7 

For the LeadingOnes problem, let the Markov chains {6}t=o {ftlttfo model the (2:2)-EA with 
one-bit mutation and one-bit crossover and that with one-bit mutation only, respectively. When 
n > 2, wehaveE[r'l < E|r]l < E|r'l/(1 -pe) ai5dE[r] - E|t']1 e n{nj^J. 

Proof. For any population a; = {si, S2}> we denote LOi andL02 as the number ofleading ones of the 
solution si and that of S2. respectively. Without loss of generality, we suppose that LOi < LO2. We 
denote i and j as the number of O's of the solution si and that of S2, respectively, i.e., ? = n - || si || , j = 

n- \\S2\\. 

We split the state space X into several cases in terms of the relation between LOi and LO2, and then 
consider this formula in each case. 

If LO2 — n, the optimal solution has been reached. We then have 

since the (2:2) -EA keeps the best so-far solution. 

Otherwise, we consider two cases: 
case 1: LOi = LO2. We have 

= PcE(^,J) + (l-pc)(E(^,i)-l) 
= Pc + E{i,j) - 1 

where the first inequality is by Proposition|3]and Lemma[I] and the last inequality is by Lemma[TJ 

case 2: LOi < LO2. It is not difficult to see that the part of a solution after the first bit is randomly 
distributed, since the reproduction and the selection of the (2:2) -EA does not affect them. We denote 
as the set of the populations in this case. Then, the probability that ||.si|| = n — iA||s2|| — n-j{0< 
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i < n - LOi,0 < j < n - LO2) is ^..A'oi-i ■ 2^-lo.2-' ' '"■*(<%'<)• The set of the populations with 
II Sill =n~i ^\\s2\\ = n - j in this case is denoted as X^^^j. Then, we consider two subcases, 
case 2a: niin{i, j} > 1. Then, we have 



1 n — 2 1 i — 1 

^t(^<,.j)(Pc(-E(z - + E{t,j) + -( — -E{i,j) 

n n n n — LUi — 1 



+ ( " ^ '^(^'J' - 1))) + (1 -Pc)(IE(z, - 1)) 

n — L(Ji — 1 

= TTtiX<,,^j)iEii,j) - 1 +p,(-l(E(j - - E(z - l,j - 1)) 

,n—l n — LOt. ~i , ,,,, 

n'^ n(n — LOi — 1) 

>^t(A'<,,j)(E(*,j)-l) 

= E ^t(^) E ^(^^+1 ^y\^'t^ ^)nr' I = vi 

where the first equality is by the random distribution of the part of a solution after the first bit, the 
second equality is by P(si(i02 + 1) = 0) n-LOi-i > Proposition[3]and Lemma[Tl the first inequality 
is by Proposition[5]and n-Lo[-i ^ ^TT"' ^'^'^ ^^^^ equality is by Lemma[TJ 

case 2b: min{i,j} = 1. Then, there are three cases, the analysis of which below is similar to that of 
case 2a. 

case 2bl: i = j = 1. Then, we have 

E '^*(^) E = y I = I e^+i = y\ 

^ — 'a;eAr<,i 1 ^ — 'yex 

77 — 2 

= ^t{X<,i,i){pc E(l, 1) + (1 1) - 1)) 

77, 

= ^t(A'<,i,i)(E(l, 1) - 1 - -E(l, 1))) 

n 

= 7Tt{X^ 1 i)(E(l, 1) - 1 - - — — )(since E(l, 1) ~ , easily derived from Proposition|4| 

277 — 1 277 — 1 

= ^ n,{x) ^ p(e^+l - y le^ = :^)E[r' i - - -^^,(a'<,i,i). 

-'^2;eA'<,ia ■■^j/GA' ^ ^ 277 —1 

case 2b2: 7 > 1 A j = 1. We have 

E ^*(^) E - y I = I ^^+1 = yj 

^ — 'x^X^^i^x ^ — 'y^X 

= ^t(^<,M) E E = y I 6 - ^)EIt' I ^^+1 = 7/1 

77 — 2 1 1 7 — 1 

= ^i(A'<,,.i)(Pc( E(7, 1) + -E(7 -1,1) + -( Yj, rE(i, 1))) + (1 - Pc)(E(7, 1) - 1)) 

77 77 n n — LUi — 1 

= ^,(A'<,,,i)(E(z, 1) - 1 + Pc( Ae(7 -1,1)+ »^ -2n + XQi + 1 ^^^^ 

77^ 77^(77 — _LCl — Ij 
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(since E(i, 1) > , easily derived from PropositionH]) 

2ri — 1 

case 2b3: z = 1 A j > 1. We have 

- -*('^<,i.) E.e.<,,, E,,;, ni... = . I - -)IB:[r' I = ,1) 

T7 — 2 1 

= ^,(A'<,i^,)bc(^E(l, J-) + -E(L J- - 1)) + (1 -p,)(E(l,j) - 1)) 
= ^t(A'<,i,,)(E(l, j) - 1 + ^m,3 - 1) - E(l, j))) 
>^t(A-<,ij)(E(l,j)-l-^;^) 

9 

77, 

(since E(l,j) — E(l, j - 1) < ^ ^, easily derived from Propositions]) 

Combining the above three cases in the case 2b, we have 

■"^^ — ^ x^X^^ij ,Yain{i,j\ — l ^ — y^'^ 

n — LOi n— LO2 

= (E+E E+E E M^)J2y^^Piit+i=y\(t=:c)Elr'\C+, 

■'^^ — ^a;e^< i.j,inin{ij} — 1 ■'^^ — ^y^-^ 

n — LOi n — L02 

Pc 



-( ^ 7rt(A'<,,,i) - ^ 7rt(A'<,i,,)) 



2n . 

i=2 j=l 

> E ■ r 1 E = 2^ I = I ^^+1 = yi 

where the last inequality is by V2 < i < n - LO2 ■ T^tiX^^^A) = ^^-Lo'^-i.a^.-i.Oa-i > 7rt(A'< 
^i-I^^'I^bSli and LOi < LO2. 

Combining all the above cases, we have 

Vi : ^ ^t(a;)P(6+i =2/16= a;)E[r' | C^+i = 2/1 

> E .,^t(2^)^(6'+i = 2/ = x)EIt' I e^+i = 2/1 +PcMLOi = LO2 < n). 

Therefore, by MCST, we have 

00 

E|t1 > E[t'1 +PcY. ""tiLOi = LO2 < n) 

t=o 

°° 1 1 1 

> EM +PcY.iT jt^kpc + (1 -pc)(i - -ry 

27 



(1 -pj(2n- 1)^3 3-4«^' 
where the second inequality is by Proposition^ 

Thus, we have E [r]] > E |r'| , and the expected running time increment satisfies that E [[r| - E |r'| G 

Then we prove E [r] < E|t'|/(1 - pc). For any non-optimal population cc = {si, S2} with l|sil| = 
n — i A \\s2\\ = n — j, we have 

^ — 'j/eA' 

<PcE(z,j) + (l-pc)(E(z,j)-l) 
= E(i,j) - 1+pc 

= E,e;t ^(^^+1 ^y\^t = I = 2/1 + Pc, 

where the first inequality is by Proposition|3]and Lemma[T] and the last equality is by Lemma[TJ 
Thus, we have 

: E ^^^t{x)P{£.t+i =2/16= x)nr' I ^'t+i = 2/1 

< 5] = 2/ = x)nr' I = 2/I +pc{i - irtix*)). 

Then, by MCST, we have E[[rl < E|t'1 + PcE^o(1 ^ T^tl-^*)) = IE[t'1 + pM^l- Thus, E|t1 < 
nr'\/{l-Pc). □ 

7.2. On OneMax problem 

First, we will analyze the one-step transition behavior of the (2:2) -EA with crossover and that without 
crossover on the OneMax problem, i.e., P(6+i | 6) andP(^t_,_i | £,[). 

Proposition 7 

For any non- optimal population x = {s\,si\, denote S[ as the set of solutions which flip one bit 
ofsi andS'2 as the set of solutions which flip one bitofs2. Leti and j be the number of Os ofsi and 
S2, respectively. Let k be the number of positions where the bitofsi is and the bitofs2 is 1. Then, 
for{^J}^g, we have 

P{(t+i e ^1 = {{4, 4} I s[ e S[,s'2 G S'2} \C^x) = ^, 

{n - i)j 



P{C+l^X2^{{s,,s'2}\s'2eS'2}\C^x) 

}\s[e S[} I C 

(n - i)(n - j) 



m+i e -^3 = {{4,^2} I s[ e S[} 



n- 

P(^t+i e X - XiU X2U X3U {x} \ C ^ x) ^ 0; 
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and for {^f}J^o' we have 

PcU -i + k) (1 - pc){n - i)j 



Pck , (1 -Pc){n-j)i 



n 

p.., I c' \ Pc{n + i-j - 2k) {I - pc){n ~ i){n - j) 

WyeX-X^UXsUix}: P(6+i ^ y \ = x) = {l-p,)PiC+i ^y\Ct^x). 

For the OneMax problem, it is easy to see that the optimal solution is 11 ... 1. For the Markov chain 
{Cf}tS), it is obvious that the CFHT EI[t/ | Ct = {«!, S2}j only depends on the number of I's of the 
two solutions, i.e., {||si||, l|s2||}. Given a population {si, S2} with |l.si|| = n - i and ||s2|| = n - j, we 
denote E(?:,j) as the CFHTEUr' | = {si,s2}I ofEA using mutation only 

Then, we give three propositions on the property of the CFHT E|[r' | Ct = {^i, S2}i- Proposition[8]is 
the instantiation of Lemma[T]for (2:2) -EA with mutation only on the OneMax problem. Propositions 
|9]and[l0]compare the CFHT from adjacent populations, where the number of 1 bits for one solution 
is same, and the difference of the number of 1 bits for the other solution is 1. 
Proposition 8 

The CFHTof{^'t}+^ on the OneMax problem satisGes that 

Vi > 0,E(i,0) =E(0,i) =0; 
Vz,j> 1,E(^,J) = 

(i+j)n-ij {i+Jjn-ij {i+j)n-i3 {i+j)n-ij 

Proposition 9 

The CFHTof{Ct}t^ satisfies that 

\^i>l,S>l:E{i,i + S)-E{i,i + S-l)> 



3 n 1 

Vz> l,<5>0:E(^,^ + 5)-E(^-l,^ + 5) < (1 - + 
Proposition 10 

The CFHTof{Ct}tJS satisfies that 

Vi > 0, (5 > 1 : E(i, i + (5) - E(i, i + 5 - 1) < 



2(z + S) ' 



Ti 

Vi > 1, (5 > : i + S) -E{i - IJ + S) > —. 

2i 

Then, we will analyze the distribution tt^. First, we define several notations for the simplicity of 
analysis. For population a; = {si, S2}, we define A^a;(0, 1) = 5I]r=i(l ^ *i(*))*2(*)' i-^-' the num- 
ber of positions where the bit of si is and the bit of .S2 is 1. Similarly, we can define Nx{0, 0) and 
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Nx{l,0). In the evolutionary process, it is obvious that the change of the bit-pair on each position 
of the population is independent. For the Markov chain {6}t^o' given the distribution nt of , we 
define (0, 1) as the probability that the bit of the first solution on one position is and the bit of 
the second solution on the same position is 1. Similarly, we can define pt(0, 0). In Proposition [TTl 
we calculate ^4(0, 0) and pt{0, 1). In Proposition [12] we derive a relation of the expected value of 
Nx{0, l)/{Nx{0, 1) + Nx{0, 0)) between adjacent time steps. From these two propositions, we estab- 
lish a relation among A^a;(0, l)/{Nx{0, 1)+Nx{0, 0)),pt(0, 0) andpt(0, 1), which is given in Proposition 



Proposition 1 1 

For the Markov chain {6}t^0' we have 



4 n rt^ 



ft(0,l) 



n-l 



- ^ + + if otherwise. 



Proposition 12 

For the Markov chain {6}t^o; we have 
Proposition 13 

For the Markov chain {6}t^0' we have 
Theorem 8 

For the OneMax problem, let the Markov chains {6 ItL'o ^^d {CAtS ■ When n > 2, we have E |t'| < 
EH < E[r'l/(1 -pj andEM -Elr'l £ l^(n^). 

Proof. For any population a; ~ (si,s2) such that niax{||si||, ||s2||} = n, we have 

= J2yex ^y\^'t = I ^^+1 = = 0' 

since the (2:2) -EA tracks the best so-far solution. 

Let (i, j) be the set of populations such that the first solution has i number of O's and the second solu- 
tionhasj number of 0's,7rf((i,j)) = ^^g^^^^.^ 7rt(a;), andEi,,j(A^(0, 1)) = 77(^ Mx)N^{0,l) 
be the expected value of 7Va;(0, 1) of populations in the set (i, j) under the distribution ttj . Then, we 
have 



M^)P{^t+i =2/16= x)E[r' | Ct+i = vl 
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S.,,€* ".(ijpteVi = »!«;= j-)e|t' 11;+, = j/i 

1=1 j=i 



n + i-i-2Et,,j(7V(0,l)) 



E(z,j)) + (l-pe)(IE(*,.7)-l)) 



E E - 1, J - 1) + ^^^IE(* - 1, j) + J - 1) 

i=l j = l 

(n-z)(n- j) 
5 lEU,.?)) 



EE'^*(*'-?')^'-(;^(^(* - +IE(^,.7 - 1) -E(z - 1,.? - 1) -E(i, j)) 
i=i j=i 

z-Et,,j(iV(0,l)) 



n 

n n 



-(2E(z,j)-IE(*-l,j-)-E(*,j-l))) 



i — 1 J — 1 

i=l J=l * " 

A^.(0,1) , 



= ^ (1 - (0, 1) - pt(0, 0) - ^ (a;)- 



7V.(0,1) + 7V,(0,0)^ 

where the first equality is by analyzing the one-step transition behaviors of {6}tt^ and {CAt^ in 
Proposition[71 the first inequality is by analyzing the CFHT of {£,1}^^ presented in Proposition[9]and 
Proposition[Tol the second inequality is by min{i, j} < i and max{i, j} > j, the third inequality is by 
2 = 1 in computation, the following equality is by X;r=oE"=o^*(^'j)« =Pt(0' 1) +Pt(0,0) and 
J^J^ ., E,,,,,-(jV(0,l)) ^ N,{0,1) 

and the last inequality is by PropositionfTsl 

By MCST, we get E[r] > E|r'] + n ^^/j^^^ . Thus, E[r] - E[r'] e Qin-^). Then, same as the proof 
of E|t| < E|t'|/(1 - pc) for LeadingOnes problem, we can also prove that E|t]1 < E|r']l/(1 - pc) for 
OneMax problem. □ 



8. Crossover Strategies 

We have shown that using the crossover throughout the evolutionary process does not help the 
search. In the third aspect, instead, we try to use the crossover only when necessary. We replace the 
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Reproduction step of the (2:2) -EA by a mutation and crossover strategy (M&R), which determines 
when to use the mutation and the crossover. We derive several strategies that apply the crossover 
only when necessary. The strategies involve crossover operators below. 

one-diff-bit crossover for the current two solutions, randomly choose one of the bit positions where 
the two solutions have different bits, and exchange the bit on that position. 

first-diff-bit crossover for the current two solutions, scan the solutions left-to-right, exchange the 
first different bit. 

first-diff-point crossover for the current two solutions, scan the solutions left- to -right, exchange 
bits starting from the position of the first different bit. 

8.1. On LeadingOnes Problem 

Let the Markov chain ^ model the EA with a crossover strategy, model the EA with one-bit mutation 
only, and E \t\ and E |t'| respectively denote the EFHT of (2:2) -EA with a crossover strategy and one- 
bit mutation only. Given two solutions (si, S2) such that ||si|| = n - i and ||s2|| — n — j, we reuse 
the notation E{i,j) as the CFHT E[[r;|^^ = {si, 52}! of (2:2)-EA with one-bit mutation only We also 

denote iOi = LO{si), LO2 = L0{s2), and 5 = 6{si,S2). 

We use PropositionlSltogether with[T4lto characterize the CFHT of the (2:2)-EA with one-bit muta- 
tion only. 

Proposition 14 

The CFHTof{i[]+^ satisfies that 

Vi > 0, (5 > 1 : E{i, i + 5)- E{i, i + S-l) 

71 

Vi > 1, (5 > : E{i, i + S) - E{i - l,i + S) > -. 

We start from designing a simple strategy, M&Rla, defined below, which uses the first-diff-bit crossover. 
Theorem[9]proves that the EA using M&Rla has a smaller runtime than that using one-bit mutation. 

M&Rla: Use the first-diff-bit crossover if either LOi < LO2 or (both (5 = and LOi ^ LO2); Use the 
one-bit mutation otherwise. 

Theorem 9 

For the LeadingOnes problem, given the crossover strategy of the (2:2)-EA being implemented by 
M&Rla, whenn> 2, wehaveE|T| < E|t'|. 
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Proof. For any population a; — {si,s2} such that ||si|| = n — i and ||s2|| = n - i - S{S > 0). 

a) in the case LOi < LO2, the first different bit of the two solutions is after the leading 1 bits of 
si, where the bit of si is and that of S2 is 1. Then, the first-diff-bit crossover exchanges the bit on 
that position and reproduces two solutions {sf , S2}, this results that ||sf || = n - i + 1 and ||sf || = 
n-i-S-l. Note that the fitness of sf is larger than that of si and the fitness of is lower than that 
of S2, therefore, after the selection, two solutions {s[, S2} are selected into the next iteration, where 
s[ = sf and S2 — S2. Therefore, we have that \\s[\\ ^ n - i + 1 and ||s2|| = n — i — S. 

Similarly, in the case S = A LOi ^ LO2, wo.l.g., let LOi < LO2, we also have \\s[\\ = n - i + 1 and 
IIS2II =n-i-S. 
Thus we have 

J2 Pi^t+i = y I 6 = ^Mrt+i I C+i = 2/1 

yex 

= E{i-l,i + S) 

< E{i, i + S) - - < E{i, i + 6)-l. 

b) otherwise, it uses the one-bit mutation, which yields 

J2 Pi^t+i = y I 6 = 2;)e(t,Vi I C+1 = y) 

yex 
yex 

= E{i,i + S) - 1. 
Thus, for any population x, it satisfies that 

^ p(6+i = y I 6 = ^MrUi I C+i - yl 

yex 

< E{i,i + 5) - 1 
yex 

By Theorem[U we immediately have E [[rl < E [[r'l . □ 

Under a different condition, we can design another strategy, M&Rlb. Theorem[To]proves that M&Rlb 
is superior than one-bit mutation. 

M&Rlb: Use the first-diff-bit crossover if both LOi > LO2 and < S < 2; Use the one-bit mutation 
otherwise. 

Theorem 10 

For the LeadingOnes problem, given the crossover strategy of the (2:2)-EA being implemented by 
M&Rlb, when n > 16, wehaveE|T| < E|t']1. 
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Proof. For any population a; — {si,s2} such that ||si|| = n — i and ||s2|| = n - i - S{S > 0). 

a) in the case < S < 2 A LOi > LO2, using the first-diff-bit crossover, together with the selection, 
reproduces two solutions {s'l, S2} such that \\s[\\ = \\si\\ = n - i and ||s2|| = n - i - S + 1. 

Thus we have 

yex 

= E{i,i + S -1) 

<E{i,t + S)^^ <Eit,i + S)-l. 

b) otherwise, it uses the one-bit mutation, which yields 

J2 ^(6+1 = y I 6 = ^Mrt+i I ^t+i = y) 

yex 
yex 

= E{i,i + S) - 1. 
Thus, for any population x, it satisfies that 

E ^(6+1 = y I = ^MrUi I C^+i = 2/1 
yex 

< E{i,i + S) - 1 

= E ^(^^+1 - y = I Ct+i = yl- 

By Theorem[U we immediately have E [[r] < E [[r'] . □ 

From the proofs of Theorems[9]and[T0l we can find that the first-diff-bit crossover operator works in 
different ways under different situations. For the two solutions in the current population, under the 
condition of M&Rla, the crossover helps the solution with better fitness but farther to the optimal 
solution (i.e., smaller number of 1 bits), while under the condition of M&Rlb, the crossover helps 
the solution with worse fitness and farther to the optimal solution. 

Since the strategies M&Rla and M&Rlb work under non-overlap conditions, they can be combined 
into one strategy, M&Rl. Corollary [T] shows that M&Rl is better than the mutation operator, which 
is proved by combining the proofs of Theorems[9]and[Tol 

M&Rl Use the first-diff-bit crossover if either M&Rla or M&Rlb would be triggered to use the first- 
diff-bit crossover; Use the one-bit mutation otherwise. 

Corollary 1 

For the LeadingOnes problem, given the crossover strategy of the (2:2)-EA being implemented by 
M&Rl, whenn> 16, wehaveE|r| < E|r'|. 
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Since M&Rlb improve the worst solution by exchanging the first different bit, we further designed 
M&R2 which uses first-diff point crossover to exchange all the bits following the first different bit. It 
can also be proved that M&R2 is better than the mutation. 

M&R2: Use the first- diff-bit crossover if either LOi < LO2 or (both S = and LOi ^ LO2); Use the 
first-diff-point crossover if both LOi > LO2 and S ^ 0; Use the one-bit mutation otherwise. 

Theorem 1 1 

For the LeadingOnes problem, given the crossover strategy of the (2:2)-EA being implemented by 
M&R3, whenn> 8, wehaveE[r] < E[r'l. 

Proof. For any population a; = {si,s2} such that |jsi|| =n — i and ||s2|| =n — i — d{6 > 0). 

a) in the case LOi > LO2 A ^ > 0, it uses the first-diff-point crossover, which reproduces two solu- 
tions { s'l , S2 } such that \\s[\\ = n - i and 1 1 1 1 = n - i. Thus we have 

= Ep,il 

77 1 Tl 

< El^,^ + Sl - -(1 - ^) < Eli,t + Sj - - < E[z,z + <51 - 1 

b) in the case LOi < LO2 or LOi ^ LO2 A (5 = 0, it uses the first-diff-bit crossover, so we have already 
known that 

J2 m+i = y I 6 = ^MrUi I C+1 = yl 

yex 

Tl 

= Ep - + < Eli,i + Sl --< Eli,i + Si - 1. 

c) Otherwise(in the case LOi ~ LO2), it uses the one-bit mutation only, 

E = y I 6 = x)nr't+i I i't+i = yl 

vex 
yex 

= E{i,i + S) - 1. 
Thus, for any population x, it satisfies that 

E p(6+i = y\^t = a^)E[T,Vi I ^t+i = yl 

yex 

< E{i,i + 5) - 1 

= E ^(^^+1 = y\Ct = ^)EK+i I C+i = yl 

yex 

By Theorem[U we immediately have E [r] < E [r'] . □ 
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8.2. On OneMax Problem 

We reuse the notations ^, C> 3 and E{i,j) as in the previous subsection, except that the EAs are 
running on the OneMax problem. 

We use Proposition[T5l which can be simply derived from Proposition[9] and Proposition[TO]to char- 
acterize the CFHT of the (2:2) -EA with one-bit mutation. 

Proposition 15 

The CFHTof{(,'t}t^ satisfies that 

Vi>l,(5>l: E{i,i + S)-E{i,i + 5-l)>l, 

Vi>l,(5>0: E{i,i + 5) ~Eii-l,i + 5) < -. 

i 

We then analyze the strategy M&R3 that uses a one-diff-bit crossover. 

M&R3: If the two solutions are not identical, within probability 0.5, use the one-diff-bit crossover if 
n>{i + 5){l + ^^)^ Otherwise, use the one-bit mutation. 

Theorem 12 

For the OneMax problem, given the crossover strategy of the (2:2) -EA being implemented byM&R4, 
whenn > 2, wehaveE|Jr] < E|r'|. 

Proof. For any population x = {si, S2} such that ||si|| — n ~ i and ||s2ll = n — i - S{S > 0), it uses 
either one-bit mutation or one-diff-bit crossover in any step. 

a) using the one-diff-bit crossover together with the selection, two offspring populations {s'^, §2} are 
possible to be reproduced. The first one is that \\s[\\ = n - i + 1 A Hsjll ^ n - i - 6, and the second 
one is that \\s[\\ = n - i A HsjH = n - i - 6 + 1. 

For the first possible offspring population, under the condition n > 2i, we have that, 

fl 

= E(i-l,i + 5) < E{i, i + 5) < E(i, i + d) -1. 

For the second possible offspring population, under the condition n > {i + S){1 + "^^_|^] )', we have 
that, 

yex 

fl 

^E{i,i + 6-l)<E{t,i + S)-- ^^<E{i,t + 6)-l. 
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b) otherwise, it uses tiie one-bit mutation, which yields 

= E{i,i + S) - 1. 
Thus, for any population x, it satisfies that 

E ^fe+i = y I 6 = 2;)E[t,Vi I = yj 
yex 

< E{i,i + S) - 1 
yex 

By Theorem[TJ we immediately have E [[r] < E [[r'] . □ 

In the proof, we observed that the one-diff-bit crossover improves either of the solutions in the pop- 
ulation. In the case the better solution is improved, the improvement on the population is greater 
than that by one-bit mutation, under the condition n > 2i; and in the case the worse solution is im- 
proved, under the condition n > {i + S){l + "'^^] )', the improvement is greater than that by one-bit 
mutation. Note that the latter condition contains the former. The condition n > {i + 5){1 + "'^^_^] )^ 
will hold when both i and 6 are small, which means the solutions are close to the optimum. Mean- 
while, note that the closer the solutions to the optimum, the more time the one-bit mutation takes 
to make an improvement. Thus M&R4 works better as the solutions getting closer to the optimum. 

9. Empirical Verification 

To verify the derived asymptotical results, we carried out experiments. On each problem size, we 
repeat independent runs of each implementation of the EA for 1, 000 times, and then the average 
running time is recorded as an estimation of the expected running time. For the parameter pc of 
the crossover probability in the (2:2)-EA, we use values {0, 0.1, 0.5, 0.9}, where Pc = equals to the 
mutation- only EA. 

We first verify the results of Theorems [7] and [S] which indicate that the running time of (2:2) -EA 
will increase at least i}{nj^^) by using the crossover with probability pc- We plot the results of the 
estimated running time in Figure [TJ On both of the problems, it can be seen that the curve of the 
(2:2) -EA with mutation only (i.e. pc^O) is below all the curves. As pc increases, the corresponding 
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Figure 1: Comparison of the estimated EFHT of (2:2)-IiA with one-bit crossover and one-bit mutation. 

curve rises, which is consistent with the theoretical results that says using the crossover operator 
leads to larger expected running time. 

To get a closer look of how tight is the bound ri(nY^), we calculate the running time gap as 

1 1 — Pc 

(EFHT of crossover-enabled EA - EFHT of mutation-only EA) • — • -. 

n Pc 

By the derived the bound ^{nj^^), the gap should be a constant or increase as n increases. We plot 
the experiment result of the gap in FigureEl We can observe that, for the LeadingOnes problem, the 
curves of the gap grow in a closely linear trend, and for the OneMax problem, the curves grow in a 
closely logarithmic trend. The observation confirms bound n{nj^), and also suggests that there 
is still room to improve the bound. 

Theorems [7] and [8] also say that E[[t| < E|t'| • j-^^, i.e., the running time of the crossover-enabled 
EA is at most times of that of the mutation-only EA. We then investigate the ratio calculated as 

EFHT of crossover-enabled EA 
EFHT of mutation- only EA ' " '^"'^ 

and compare it with 1. We plot the experiment result of the ratio in Figure HJ The figure shows that, 

on the two problems, the ratio is consistently bounded by 1 except when the problem size is very 

small that causes a large variance. 

We then investigate the crossover strategies. Figure |4] plots the curves of estimated EFHTs of the 
(2:2) -EA with different operators. It can be observed that, on the LeadingOnes problem, both the 
curves of M&Rla and M&Rlb (the curves are overlapped) are consistently better than the mutation 
only curve. Since M&Rla and M&Rlb apply the crossover in different conditions, their combination 
M&Rl is better than either M&Rla or M&Rlb. It also shows that M&R2, which uses first-diff-point 
crossover to exchange a part of the solutions at a time, is better than M&Rl, which exchanges one 
bit at a time. We can also observed that the M&R3 designed for the OneMax problem performs well 
than mutation only. 
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10. Conclusion 



This paper extends our preliminary research 138|] . Due to the irregularity and complex interactions 
to mutation and selection operators, crossover operators are hard to be analyzed. In this paper, we 
propose the General Markov Chain Switching Theorem to facilitate the analysis of crossover. Instead 
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of directly analj^e an EA, GMCST compares two EAs. In the comparison, the long-term behavior 
of one of the two EAs is not required, but only need to analyze the one-step transition behavior. 
Therefore, by GMCST we can compare a crossover-enabled EA with an easy-to-analysis EA, so that 
we can analysis the crossover-enabled EA without touching its long-term behavior. 

Using GMCST, we analyze several crossover- enabled EAs on the LeadingOnes and the OneMax 
problems, which are notably two model problems well-studied for mutation-only EAs but have few 
results for crossover. Our analysis is in three aspects. In the first aspect that is to bound the asymp- 
totic running time of crossover-enabled EAs, we derive upper and lower bound of the (2+2) -EA with 
several crossover operators. In the second aspect that is to compare the running time of crossover- 
enabled EAs with their counterpart mutation-only EAs, our analysis shows that the crossover opera- 
tor slows down the (2:2) -EA, but within a bounded factor. The reason that the crossover is not helpful 
here may be that the EA dose not create a good diversity among solution on the two uni-model sim- 
ple problems. In the third aspect that is to use crossover smartly, we design several strategies that 
use crossover only when necessary, and we prove the effectiveness of the strategies. These theoreti- 
cal results are then verified by experiments. 

Although we use the GMCST to analyze crossover in this paper, it is worth noting that GMCST is 
a general tool that can be used for analyzing other sophisticated metaheuristic algorithms, which 
appear often in real-world applications. We will exploit the power of GMCST in the future. 

11. Acknowledgments 

to be added... 
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For any solution with j(l < j < n) O's, the number of O's will never increase since the selection of 
the (1+1>)-EA, and in one mutation step, a solution with j - I O's will be generated with probability 
i, otherwise the solution keeps unchanged. Thus, the expected steps to decrease the number of O's 
by 1 is n. Then, the expected running time to get to the optimal solution from a solution with j O's is 
jn. □ 

Proof of Proposition|2l 

For any solution with j(l < j < n) O's, the number of O's will never increase since the selection of 
the (1+1)-EA, and in one mutation step, a solution with j - 1 O's will be generated with probability 
^, otherwise the solution keeps unchanged. Thus, the expected steps to decrease the number of O's 
by 1 is y for the solutions with j O's. Then, the expected running time to get to the optimal solution 
from a solution with j O's is X^Li f = '^^j • ^ 



B. Proofs for SectionE] 
Proof of PropositionlHl 

For the (2:2)-EA with mutation only (i.e., {Ct}'t°^o^' it behaves like two independent (1+1)-EA which 
only accepts better solutions. Thus, for any non-optimal solution, the offspring will be accepted 
only if the first bit is mutated, the probability of which is i; otherwise, the solution will keep 
unchanged. Thus, the above one-step transition behavior for {CAt^o trivially holds. 

For the (2:2)-EA with crossover (i.e., {^t}'^o), it uses crossover with probability pc in every repro- 
duction step; otherwise, it uses mutation. Since only better solutions wiU be accepted in the se- 
lection procedure, the offspring which flips the first bit of the parent wiU replace the parent, oth- 
erwise, the parent will not change. If it uses mutation, it behaves like {Ctlt^o- If it uses crossover, 
we consider two cases in terms of the number of leading ones of the two solutions. In the case of 
LOi = LO2, one-bit crossover will never generate offspring solutions which flip the first bits of 
parent solutions, since the first bits of the two parent solutions are in the same position. In the 
case of LOi < LO2, if the crossover position is LOi + 1, which happens with probability i, it will flip 
the first bit of si and S2 will not change, since si{LOi + 1) = and s2{L0i + 1) = 1; if the crossover 
position is LO2 + 1, which also happens with probability i, since S2{L02 + 1) = 0, it willfiip the first 
Obitofthe second solution S2 and the first solution si will not change in the case ofsi(L02 + l) = 1) 
and the two parent solutions will not change in the case of si (LO2 + 1) = 0; otherwise, both the two 
parent solutions will not change. Thus, the above one-step transition behavior of {6}t^o trivially 
holds. □ 
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Proof of PropositionlH 



Since the population with at least one solution 1" is optimal, it is trivial that E(i,0) = 0. By the 
one step transition behavior of (2:2) -EA with one-bit mutation only on the LeadingOnes problem 
analyzed in the Proposition|3j we have Vi, j > 1, 

n — 1 n — 1 1 (n — 1)'^ 
E{i,j) = 1 + -^E{i - + -^E{i,j - 1) + —E{t - l,j - 1) + ^ ^E{i,j). 

Thus, 

Tl^ 11j — 1 71—1 1_ 

j) = TT-^ + TT-^n^ - 1, j) + TT-^n^.J - 1) + 7r—:W 1,.? - !)• 



2n-l 2n-l ' ■" 2n - 1 ' ' 2n - 1 



□ 



Proof of Proposition^ 

We prove the proposition by induction on i + i + 15. All the equalities below are not hard to derive by 
analyzing the CFHT of {CJIi^o PropositionlH and all the inequalities can be derived by inductive 
hypothesis. 

(a) Initialization: 

When i + i + S ^2,we have E(l, 1) - E(0, 1) = <n~ 

When i + i + 5 = 3, we have E(l, 2) - E(l, 1) = > f, E(l, 2) - E(0, 2) = ^^Z-ly ^ " " TT"- 

(b) Inductive Hypothesis: Assume 

for 2 < i + i + 5 < A:, we have 

Vi > 1, (5 > 1 : E(i, i + 5)- E{i, i + 5 - \) > 



Vi > 1, (5 > : E(i, i + 5) - E(i ~ l,i + 5) < n - 



2-5+2' 

(3?i - 1) 



2^+3 



We then prove that the two inequations still hold when i + i + 5 = k + l. 
First, we consider E(i, i + 6) - E(i, i + 5 -1). 

(1) When i = 1, we have E(l, k) - E(l, fc - 1) = "'^'-1^' > ^ttt- 

(2) When i > 1, we have 

Vi > 1, (5 > 1 : E(i, i + (5) - E(i, i + 5 - 1) 

Ti^ 1 71 — 1 n 

-E{i -l,i + 6 -^)^ E{i -l,i + 5) E(i, i + 5 ~ I) 



2n~l 2n-l ' ' ' 2n - 1 ' ' 2n - 1 

> E{i + S -\) + E i -lA + 5) (n - ^ 

- 2n-l 2n-l ^ ' 2n - 1 ^ ' ' 2n - 1 ^ 2*+2 ' 

•n? n — ln n , (3n— 1), 

- 2n - 1 2n - 1 2'5+3 2n - r 2*'+2 ' 

n 
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where the first inequality is by E(i, i + 6 - 1) - E{i - l,i + 5 - 1) < n- -^^^ since i + i + S- l = 
kAi>2Ai + S- l- i>0, and the second inequality is byE(i - 1, i + 5) - E(i - 1, i + (5 - 1) > 

since i-l + i + d = kAi-l>lAi + S- i + l>l. 



Second, we consider E{i, i + S) ~ E{i ~ + S). 



(1) When i = 1, we have E(l, k) - E(0, k) ^ n - < n - ^ii^ 



(2) When i > 1 and 5 = 0, we have 

Vi > 1 : E(i,i) - E{i - 

2{n-\) , , 1 



E{i - 1, i) + -E{i - 1, i - 1) - E(i - 1, i) 



2n - 1 2n - 1 ' ' 2n - 1 

^2 1 ^ 1 



-E{i - 1, i) + E(i - 1, i - 1) 



2n - 1 2n - 1 ' ' 2n - 1 

2 



n 

< 



2n-l 8{2n - 1) 
3n- 1 

where the first inequality is by E(i-l,i) — E(i- 1,1 — 1) > | sincei-l + i = fcA«-l > lAi-z + l > 1. 
(3) When i > 1 and (5 > 0, we have 

Vi > 1 : E(i, i + (5) - E(i - 1, i + (5) 

71^ 1 7i — 1 Tl 

-E{i - + 5 - 1) + -E{i, i + S-1)- -E{i -l,i + S) 



2n - 




2n 


- 1 






n - 


- 1 


2n - 


1 


^ 2n 


- 1 






n - 
h — 


- 1 



2n - 1 ' ' ' 2n-\ 

Tl — " 1 

< — h — — -E{i, i + 5-l) E{i - 1, i + (5 - 1) 



2n-l ^ ' ' {2n- l)2'5^ 



^ 3n — 1 



< n 



2-5+2 ' (2^-1)2-5+3 
3n - 1 



2-5+3 ' 

where the first inequality is by E(i - 1, i + 5) - E{i — 1, i + 5- 1) > since i-l + i + 5~kAi — l > 
lAi + S- i + l > 1, and the second inequality is by E{i, i + 5 - I) - E{i - l,i + 5 - I) < n - 

since i + i + S- l = kAi>2Ai + d- l- i>0. 

(c) Conclusion: According to (a) and (b), we have 

\/i>l,S>l:E{i,i + S)-E{i,i + S-l)> 



2-5+2' 

3n — 1 

Vi > 1, 5 > : E(i, i + 5) - E(i - 1, i + 5) < n 



2-5+3 ■ 

□ 



Proof of Proposition|6j 
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We prove this proposition by induction on t. 

(a) Initialization For i = 0, we have 

7ro(£Oi = LO2 < n) 

1111 1 1 11 

~2'2^22'22"^ ^ 2"-i ' 2"-i ^ 2" ' 2" 
_ 1 1 

~ 3 " 3 •4"' 

where the i-th term ~ ■ — in the first equality is the probability that LOi — LO2 — i - 1, which can 
be easily derived since the initial distribution ttq is uniform. 

(b) Inductive Hypothesis Assume that for < < < X - 1, 

TTtiLOi = LO2 < ") > - ^)iPc + (1 -Pc)(l - ^)')*. 

Then, for < = _ftr, we have 
■kk{LOi = LO2 < n) 

>^K-i{L0i=L02<n)-{p, + {l-p,){l--f) 

n 

>{\- ^)iPc + (1 - Pc)(l - -ff-' ■ (Pc + (1 - Pc)(l - -f) 

3 3-4" n n 

^{\-^)iPc+ii~Pc)ii--rf, 

3 3-4" n 
where the first inequality is since one-bit crossover and one-bit mutation which does not flip the 
first the bit of the parent solution will keep LOi — LO2 in the next population when the current 
population satisfies that LOi = LO2, and the second inequality is by inductive hypothesis. 

(c) Conclusion From (a) and (b), the proposition holds. □ 
Proof of Proposition|7l 

For the (2:2)-EA with mutation only (i.e., {CAuLo^' it behaves like two independent (1+1)-EA which 
only accepts better solutions. Thus, for any non-optimal solution, the offspring will be accepted 
only if one bit is mutated, the probability of which is ^ for one-bit mutation on a solution with 
i number of O's; otherwise, the solution will keep unchanged. Thus, the above one-step transition 
behavior for {Ct}t^o trivially holds. 

For the (2:2)-EA with crossover (i.e., {^t}^a), it uses crossover with probability in every reproduc- 
tion step; otherwise, it uses mutation. Since only better solutions will be accepted in the selection 
procedure, the offspring which flips one bit of the parent through either one-bit mutation or one- 
bit crossover will replace the parent, otherwise, the parent will not change. If it uses mutation, it 
behaves like {C^}^o• If it uses crossover, we consider the position of the crossover point, briefly de- 
noted as cp. If si{cp) = A S2(cp = 1), which happens with probability ^, it will flip one bit of 



47 



Si and S2 will not change; if si{cp) = 1 A S2{cp = 0), which happens with probability ^^''^'^ , it will 
flip one bit of the second solution S2 and the first solution si will not change; otherwise, both the 
two parent solutions will not change, since one-bit crossover on the position where the two par- 
ent solution have a same bit will not introduce new bits for any solution. Thus, the above one-step 
transition behavior of {Ct }t^o trivially holds. □ 

Proof of PropositionlH 

Since the population with at least one solution 1" is optimal, it is trivial that E(i, 0) — 0. By the one 
step transition behavior of (2:2) -EA with one-bit mutation only on the OneMax problem analyzed 
in the Proposition[71 we have Vi, j > 1, 

E(z,j) = 1 + 4e(z - 1, j - 1) + ^ /^ E(z - + ^ ^E(^,J - 1) + ^ ^E(i,j). 

jjZ j^Z j^Z 

Thus, 

□ 

Proof of PropositionlH 

We prove the proposition by induction oni + i + 5. All the equalities below are not hard to derive by 
analyzing the CFHT of {C^}^^o Proposition[8l and all the inequalities can be derived by inductive 
hypothesis. 

(a) Initialization: 

When i + i + 6 = 2,we have E(l, 1) - E(0, 1) = < 

When ^ + ^ + S = 3,we have E(l, 2) - E(l, 1) = ^,:1[';[,Z2) > ^(1, 2) - E(0, 2) = ^^n-mf-^) < 

13n+l 
16 • 

(b) Inductive Hypothesis: Assume 

for 2 < i + i + ^ < A;, we have 

TL 

Vi>l,d>l: E(i, i + 5)- E(i, i + 6 - I) > -r-r- -, 

3 71 1 

V*> l,5>0:E(z,« + <5)-E(*-l,* + <5) < (1--^)- + -^. 

We then prove that the two inequations still hold when i + i + (5 = /c + 1. 
First, we consider E(i, i + - E(i, i + (5 - 1). 

(fe 

I, iA — ^ 

{k+\)n-k ^ fe2'= ■ 



(1) When i = 1, E(l, fc) < n - , which can be easily proved by induction on k{k > 1). 

Then, we have Vfc > 2 : E(l, k) - E(l, fc - 1) = "^fc"'^!^'!:^^^ > 



(2) When i > 1, we have 

Vi > 1, (5 > 1, E{i, i + S)- E{i, i + S - 1) 
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+ Eii-l,i + 5-l) 



{2i + 6)n - i{i + 5) {2i + S)n - i{i + S) 

r? i{n — i — 5) 

^ {2i + S)n - i{i + 5)~ {2i + S)n - i{i + 5) ~ ^^ + ^- ) 

i{n — i — 6) , . r\ //. 3 ,n 1 , 

E(z - l,^ + 5) —————— ((1 - + 



(2i + (5)n - i(i + (5) ^ ' ^ (2i + (5)n - i(i + ^) 2'5+2^i 2'5+2 
i{n — i — 5) n 



{2i + 5)n - i{i + 5) {2i + 6)n - i{i + 5){i + 5)2^+' 
in 3 n 1 



2 



> 



{2i + d)n-i{i + 6)^^ 2^+^i 2-5+2 
n 



{i + 5)25+1 ' 



where the firstinequalityis by E(i,i+5-l)-E(i-l,i + 5-l) < (1-2^)7 + 2^ sincei+i + 5 — 1 = 
kAi > 2Ai + 6-l-i > 0, and the second inequalityis by E(j-l,i + 5)-E(i-l,i + 5-l) > (^^_^_s^2^+2 
since i-l + i + 6 = kAi-l>lAi + S- i + l>l. 

Second, we consider E(z, i + S) - E(i - 1, « + S). 

(1) When i = 1, we have Vfc > 1 : E(l, fc) - E(0,A;) = E(l, fc) < (1 - 2^)f + which can be 
proved by induction on k. 

(2) When i > 1 and (5 = 0, we have 

Vi > 1 :E{i,i) -E{i-l,i) 



-^E(i -!,«) + ^E(i - 1, i - 1) 



2m — ^2 2m — ^2 ^" ' ' 2m — ^2 

< 



< 



2m — i2 4i(2m — ^2) 

5n + i 



where the firstinequalityis by E(i-l,i)-E(i-l,i-l) > ^ sincei-l+i = fcAi-1 > lAi-i + 1 > 1. 
(3) When i > 1 and 5 > 0, we have 

Vi > 1 : E(i, i + 5) - E(i - 1, i + (5) 

r? i{i + 6) . 

~ {2i + 5)n - i{i + 5)^ (2i + 8)n ~ i[i + 5) ~ + ) 

(2i + 5)n - i(i + 5) ^ ' ^ (2i + 5)n - i(i + 5) ^ ' ^ 

^ {n~i)(i + 8) _ . . _ , X 

(2i + ,5)n - i(i + (5) (2i + <5)n-i(z + ,5) ^ ' ^ 



(2i + (5)n - i(i + (5) ^ ' ^ ((2i + 5)n - i(i + 5))2'5+2 

, + 3_ n 

(2i + S)n - i{i + 6) {2i + 6)n - i{i + S) 2-5+2 ) ^ 
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1 jf_ 

^ ^ {{2i + 5)n - i{i + 5))2^+^ 

<(1 ^ ^ 



2-5+3 ^ i 2-5+3 ' 

where the firstinequalityisbyE(i-l,i+(5)—E(i-l,i+(5-l) > since i- l+i + J = fcAi — 1 > 

lAt + (5-i + l > l,andthesecondinequalityisbyE(?;,i + J-l)-E(i-l,i + 5-l) < {l~ ^^Yj + ^h^ 
since i + i + i5-l = A;Ai>2Ai + (5-l-i>0. 

(c) Conclusion: According to (a) and (b), we have 

> 1, (5 > 1 : E(i, i + (5) - E(i, i + 5 - 1) > 



'in 1 

Vi > 1, (5 > : E(i, i + 5) - E(i - 1, i + 5) < (1 - ttt-t)- + 



2*+3 ^ i 2-5+3 ■ 

□ 

Proof of PropositionflOl 

We prove the proposition by induction on i + i + (5. All the equalities below are not hard to derive by 
analyzing the CFHT of {C^}^o Proposition[8l and all the inequalities can be derived by inductive 
hypothesis. 

(a) Initialization: 

When i + i + S = l,\Ne have E(0, 1) - E(0, 0) = < f . 

When i + i + 5 = 2,we have E(0, 2) - E(0, 1) = < f , E(l, 1) - E(0, 1) = > §• 

(b) Inductive Hypothesis: Assume 

for 1 < i + j + (5 < A:, we have 

Vi > 0, (5 > 1 : E(i, i + 5)- E(i, i + 5 - I) < 



2{i + 5) ' 



Tl 

Vi > 1, 5 > : E(i, i + 5)-¥.{i-l,i + 5)> —. 

2i 

We then prove that the two inequations still hold when i + i + 5 = k + l 
First, we consider E(i, i + 5) — E(«, i + 5 — 1). 

(1) Wheni = 0,wehaveE(0,fc + 1) -E(0,fc) = < ^ivi)- 

(2) When i > 0, we have 



Vi > 0, 5 > 1 : E(i, i + 5)- E(i, i + 5 - 1) 
V? i{i + 6) 



{2i + 5)n - i{i + 5) {2i + 5)n - i{i + 5) 
i{n — i — S) 



E{i-l,i + S -1) 



c^E(^ - + 5) - 7 -E(i,i + 6 -I) 

{2i + S)n - i{i + S) ^ ' ' {2i + S)n - i{i + S) ^' ' 

— i — 5) ,. 
^ (2i + 5)n - i{i + S)^ {2i + d)n - i{t + S) ~ + 
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{2i + S)n - i{i + S) ' ' ' 2((2i + 5)n - i(i + 5)) 



,2 



in(n — i — 5) 

< 7^7^-^:^ T7-. ?T + 



{2i + 5)n - i{i + S) 2{i + S){{2i + S)n - i{i + S)) 2{{2i + S)n - i{i + S)) 
n 



2{i + d) ' 

where the first inequality is by E{i, i + S - 1) - E{i - l,i + 5 - 1) > ^ since i + i + 6- l = kAi> 
lAi + S- l- i>0, and the second inequality is by E(i -l,i + 5) - E{i - l,i + 5 - 1) < ^(i+s) since 
i-l + i + 6 = kAi-l>0Ai + S-i + l>l. 

Second, we consider E(i, i + S) — E{i — + S). 
(1) When ^ = 0, we have 

Vi > 1 :E(i,i) -E(i- 



n2 



2m — i"^ 2in — i"^ ' 2m — P 

2 



n 

> 



2m - ^2 2(2m - i^) 
n 

" 2i' 

where the inequality is by E(i - l,i)-E{i - l,i - 1) < ^ since i - l + i = kAi-l>OAi-i + l = l. 
(2) When ^ > 0, we have 

Vi > 1 : E{i, i + 6) - E{i-l,i + S) 

~ (2i + (5)n - i{i + (5) ^ (2i + (5)n - i(z + 5) ~ '^^ ~ 



(2i + (5)n - i(i + (5) ' (2i + (5)n - i(i + J) 

(n-i){i + 5) _ . 

{2i^S)n-i{i^S) (2i^S)n-i{i^S) ^ ' ^ > 

{n-i){i-\-S) , c . 
+ .o- x^ V- i + (5 - 1) - 



(2i + 5)n - i(i + (5) ^' ' 2((2i + 5)n - i(z + J)) 

^ ^ n(n-i)(z + (5) 



(2i + (5)n - z(i + (5) 2i((2i + (5)n - i(z + J)) 2((2i + (5)n - i(i + ^)) 
n 

" 2V 

where the first inequalityis by E(i-l,i + ^)-E(i-l,i + i5-l) < ^{i+g) sincei-l + i + 5 = kAi-\ > 
OAi + d- i + l>l, and the second inequality is by E{i, i + S - 1) - E{i - l,i + d - 1) > ^ since 
i + i + S-l = kAi>lAi + 5-l-i>0. 

(c) Conclusion: According to (a) and (b), we have 

Tl 

yi>0,S>l: E(i,i + 6)-E(i,i + S-l) < — -, 

2[i + 0) 
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Tl 

Vi>l,(5>0: E(i,i + d) - E(i-l,i + d) > —. 

2i 



Proof of Propositionfm 

We prove the proposition by induction on t. 

(a) Initialization First, we havepo(0, 0) = pq{0, 1) ~ j, since the initial population is random. 

(b) Inductive Hypothesis Assume for < t < K — 1, 

4 71 rt^ 



□ 



Pt(0,l) = 
Then, for < = i^T, we have 



4a-.r+^) (1 - ^ + '-^Y + 4(iX3l) (1 - otherwise. 



PKiO, 0) - PK-i(0, 0)(pc + (1 - Pc)(l - 1)') 



1(1 - ^^1^ + i^)--bc + (1 - In 

4 n 71^ rt 



4 

where the first equality can be derived by analyzing the one-step transition behavior of {6}t^^o 
Proposition[71 and the second equality is by inductive hypothesis. Similarly, we have 

PKiO, 1) = PcPK^O, 1)(1 - 1) + (1 -Pc)(pK-l(0, 1)(1 - -)+PK-l{0, 0)(1 - 1)1) 

n n n n 

= (1 - -)PK-1{0, 1) + 1^(1 - -)PK^1{0,0) 

n n n 

Whenpc = 5^r-rT' W6 have 

PKiO, 1) = 1(1 - 1)(1 + ^)(1 - 1)^-1 + -^(1 - 1)(1(1 - 1)^-1) 

4 n Zn — 1 n Zn — 1 n 4 n 

1/ K 1,^ 

^4(^+2;^)(l-n) 

Whence 7^ ^TT' ''^s h^"^^ 



n"4(l-2n+ j^)' n n2 ' 4(l-2n+j^) 



n 



1^(1 - -)(1(1 - ^^1^ + '-^r-') 
n n 4 rt 



4(l-2n+^)^ n ^ ^ +4(l-2n+^)^ ' 

(c) Conclusion From (a) and (b), the proposition holds. □ 



52 



Proof of PropositionflZl 



E^*+i(^)Ar^(0,i) + 7V.(0,0) 



iV.(0,l) 

(0,0) 

Ny{0,l) 



E/*(-)^(^^+i=^U* = -)^.^(0,i) + ^^(0,0) 

, , , ,A^.(0,1) iV,(0,l)-l , n-iV,(0,l) iV,(0,l) 

2^ Mx)(pc[- 



n 7V,(0,1) + 7V,(G,0)-1 n TV^O, 1) + iV.(0, 0) ' 

. . (n - jV.(0, 0) - iV^(0, l))(n - iV^(0, 0) - jVx(l, 0)) jV^(0, 1) 
^ ^'^^ n2 iV,(0,l) + iV,(0,0) 

7V,(l,0)(n-iV^(0,G)- jV^(0,l)) iV.(0,l) 

n2 iV,(0,l) + iV,(0,0) 

jV^(G,0)(n-iV,(0,G)- jV^(0,l)) A^^(0,l) + 1 

n2 iV,(G,l) + iV,(0,G) 

jV^(G,G)(n-7V,(0,G)~ jV.(l,G)) A^.(G,1) 

n2 iV,(G,l) + iV,(0,G)-l 

iV.(0,l)(n-iV^(0,G)-jV.(l,G)) iV.(0,l)-l 

n2 7V,(G,l) + iV,(0,G)-l 

, iV,(0,l)iV,(l,G) iV,(G,l)-l ^ iV,(0,G)iV,(l,G) iV.(0,l) 



n2 iV,(G,l) + 7V,(0,G)-l n2 TV^G, 1) + TV^G, 0) - 1 

jV^(0,G) A^.(G,1) jV^(G,0)(jV.(0,G)-l) jV.(G,l) + l 

n2 7V,(0,l) + iV,(G,0)-l n2 iV,(G, 1) + 7V,(0, G) - 1 

iV.(0,l)iV.(0,G) iV.(G,l) 

n2 iV,(G,l) + iV,(0,G)-l^ 

^^^Ha^Jl +1 ^^^n7V,(0,l) ^"n(7V,(0,G) + 7V,(G,l)-l)^7V,(G,G) + 7V,(0,l) 
iV,(0,G) , iV,(0,l) 



nAr,(G,l)^iV,(G,G) + A^,(G,l) 

= fl - V TT (x) ^^(Q'^) , 

" A^:.(0,G) + 7V,(G,1) n 

^ n ' ^iV,(0,l)+iV,(0,G) ' *^ n ' 

where the second equality is by 7r(+i(.x) = J2yex ^i^t+i = ^ \ = y)T^t{y), and the third equality 
can be derived by analyzing the one-step transition behavior in Proposition [7] plus the change of 

iV^(0, 1)/(7V^(0, 1) + N^{0, G)) in adjacent time steps. □ 

Proof of PropositionflHl 

We prove it by induction on t. 
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(a) Initialization First, when t = 0,we have 



'iV,(0,l)+7V.(0,0) 



i=0 fc=0 i=0 ^ ■ 



2 



i-l 



= ^ < 1 -Po(0, 1) -Po(0,0) - (1 - = i 

2 n 2 

where the first equality is since the initial population is random. 

(b) Inductive Hypothesis Assume that for < t < X - 1, it holds that 



y TTtfa;) ' \ ^ < 1 -pt(0,l) -ft(0,0) - (1 



Then, we consider t ~ K. 

A^.(0,1) 



7V,(0,1) + 7V,(0,0) 



< (1 

Tl ^ ^ 



iV,(0,l) + 7V,(0,0) 



< (1 ^)(1 -pK-i(0, 1) -pK-i(0,0) - (1 ^)^-^) + 

where the first inequality is by Proposition[T2l and the second is by inductive hypothesis. 
Whenpc = ^^rzT' have 



^ ttk{x)- 



7V,(0,l) + iV,(0,0) 



< 1 



4(2n-l)^^2n-l^^ 7i^ 



<l-7(2 + 7r-^)(l--)^-(7 



4' 2ri-l" 77/ '2n-l 
1 - pi^(0, 1) - pk{Q., 0) - (1 - i^)^ 



77 

where the first inequality and the last equality are by PropositionfTTl 

Whenpc 7^ 5^1^' w6 have 



^ ttk{x)- 



7V,(0,1) + 7V.(0,0) 



^ n ^M(l-277+ j^)^ n n2 ^ 4(l-2n+j^)^ 



(1- 



<l-( 



T^-" 2(1 -p. 



4(1 - 277+^) 



2-3n + 



l-Pc 



.(1 _ L)K) _ n 

4(1 - 277+^)^ J ' ^ 
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= 1-pk{0,1)-pk{0,0) - (1 - ^^)^, 

n 

where the first inequality and the last equality are by PropositionfTTl 
(c) Conclusion From (a) and (b), we have 

yt-.yntix) , ^^(0'^) ^ <i_p^(o,l)_p,(o,0)-(l-i^)*. 



2 • 



C. Proofs for SectionH 
Proof of Proposition[T4l 

We prove the proposition by induction oni + i + S. 

(a) Initialization: 

When i + i + S = l,we have E(0, 1) - E(0, 0) = < f . 

When i + i + 6 ^2,we have E(0, 2) - E(0, 1) = < f , E(l, 1) - E(0, 1) = 5^ > 

(b) Inductive Hypothesis: Assume 

for 1 < i + i + S < k, we have 

n 

Vi > 0, ^ > 1 : E(i, i + 6) - E{i, i + S -1) < 

Ti 

yi>l,d>0: i + d) - E{i-l,i + d) > -. 

We then prove that the two inequations still hold when i + i + S~k + l. 
First, we consider E(z, i + d) — E(i, i + S — 1). 

(1) When i = 0, we have E(0, fc + 1) - E(0, fc) = < f . 

(2) When i > 0, we have 

E{i, i + 5) = l + -^E{i -l,i + S~l)+ -l,t + S) + ^E(z, 1 + 6-1) + ^^^E(^, t + 6). 

Then, E(z, t + 6) = ^ + ^E{i -l,i + 5-l) + ^E(z -l,i + 6) + i^E(^, i + S-l). 
Thus, we have 

> 0, (5 > 1 : E{i, i + 5)- E{i, i + S - 1) 

fl^ 1 Tl — 1 7i 

E{i-l,i + 6-l) + — E{i -l,i + 6) E{i, i + 6 - 1) 



2n-l 2n-l ' ' ' 2n - 1 ' ' ' 2n - 1 

< E(i - l,i + S - E(i -lA + S) 

2n-l 2n-l ^ ' ' 2n - I ^ ^ ^ I 2(2n - 1) 

TL 

(since i + i + 6 - I = k,i >l and i + 5-l-i>0, then E(i, i + 5 - I) - E{i ~ l,i + 6 - I) > -) 



TT? n(n — 1) 



„2 



2n-l 2(2n-l) 2(2n - 1) 
(since i-l + i + S = k,i-l>Q and i + S - i + I > I, then E{i - l,i + S) - E{i - l,i + S - 1) < 
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Second, we consider E{i, i + S) — E{i — + 5). 

(1) When (5 = 0, we have 

Vi > 1 : E{i,i) -E{i - 

= 2^^^ + ^^(^ - ^' ^) + 2;^'^(^ - ^' ^ - ^) - - ^' ^) 

1 1 

= Eii - 1, i) + E(i - 1, i - 1) 

2n - 1 2n - 1 ^ ' ' 2n-\ ^ ' 

n 

^ 2n- 1 ~ 2(2n - 1) 

{since i — 1 + i = k, i — 1>0 and i — i + 1 = 1, then E{i — E{i — l,i — 1) < — ) 

n 

" 2' 

(2) When 5 > 0, we have 



Vi > 1 : E(i,i + 5) -E(i- + 

77^ 1 T7 — 1 ?? 

= 2^31 + STTT^l' - M + « - 1) + 5— f E(M + i - 1) - - M + i) 

(since i-l + i + (5 = fc, ,i-l>0 and i + S- i + l>l, then E{i - l,i + S) -E{i - l,i + S - 1) < -) 

n^ in - l)n n^ 
> ^ 7 + 



2n-l 2(2n-l) 2(2n-l) 
{since i + i + 5— l = k, i >1 and i + S — 1 — i>0, then E{i, i + S — 1) — E{i — l,i + 6 — 1) > —) 

n 
~ 2 



(c) Conclusion: According to (a) and (b), we have 



Tl 

> 0,(5 > 1 : E{i,i + 6) -E{i,i + 6 - 1) < -, 

71 

yi>l,d>0: E{i,i + d)-E{i-l,i + 6)> -. 



□ 
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